Apr 15 16:22:17 devstack cinder-volume[72222]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 16:22:17 devstack cinder-volume[72222]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 16:22:17 devstack cinder-volume[72222]: we strongly recommend against using it for new projects.
Apr 15 16:22:17 devstack cinder-volume[72222]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 16:22:17 devstack cinder-volume[72222]: framework.  For more detail see
Apr 15 16:22:17 devstack cinder-volume[72222]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 16:22:17 devstack cinder-volume[72222]:   import eventlet  # noqa
Apr 15 16:22:19 devstack cinder-volume[72222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 16:22:19 devstack cinder-volume[72222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 16:22:19 devstack cinder-volume[72222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 16:22:19 devstack cinder-volume[72222]: INFO dbcounter [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Registered counter for database cinder
Apr 15 16:22:19 devstack cinder-volume[72222]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:22:19 devstack cinder-volume[72222]: DEBUG dbcounter [-] [72222] Writer thread running {{(pid=72222) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 16:22:19 devstack cinder-volume[72222]: INFO cinder.rpc [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 16:22:19 devstack cinder-volume[72222]: INFO cinder.rpc [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 16:22:19 devstack cinder-volume[72222]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:22:19 devstack cinder-volume[72222]: INFO cinder.volume.manager [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Determined volume DB was empty at startup.
Apr 15 16:22:19 devstack cinder-volume[72222]: DEBUG cinder.volume.manager [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72222) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 16:22:19 devstack cinder-volume[72222]: INFO cinder.volume.manager [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 16:22:19 devstack cinder-volume[72222]: WARNING stevedore.named [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 16:22:19 devstack cinder-volume[72222]: WARNING castellan.key_manager [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 16:22:19 devstack cinder-volume[72222]: WARNING cinder.keymgr.conf_key_mgr [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG cinder.volume.drivers.lvm [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72222) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_concurrency.processutils [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72222) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_concurrency.processutils [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.267s {{(pid=72222) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:22:20 devstack cinder-volume[72222]: INFO cinder.rpc [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 15 16:22:20 devstack cinder-volume[72222]: INFO cinder.rpc [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 15 16:22:20 devstack cinder-volume[72222]: WARNING stevedore.named [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 16:22:20 devstack cinder-volume[72222]: WARNING castellan.key_manager [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 16:22:20 devstack cinder-volume[72222]: INFO cinder.volume.manager [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:22:20 devstack cinder-volume[72222]: INFO oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Starting 1 workers
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Started child 72329 {{(pid=72222) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Full set of CONF: {{(pid=72222) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] ******************************************************************************** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Configuration options gathered from: {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] ================================================================================ {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] allow_availability_zone_fallback = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] allow_compression_on_image_upload = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] allowed_direct_url_schemes     = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] api_rate_limit                 = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] auth_strategy                  = keystone {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] az_cache_duration              = 3600 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_availability_zone      = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_host                   = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_name                   = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_stats_polling_interval = 60 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backup_api_class               = cinder.backup.api.API {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backup_name_template           = backup-%s {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backup_use_same_host           = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backup_use_temp_snapshot       = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] chap_password                  = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] chap_username                  =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cinder_internal_tenant_project_id = b13b5c06cf4d4854b053663a716acd21 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cinder_internal_tenant_user_id = 5beebd9c16294f388f6cff68c00f8900 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cloned_volume_same_az          = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cluster                        = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] compression_format             = gzip {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] config_dir                     = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72329]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] config_source                  = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] control_exchange               = openstack {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] debug                          = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] default_availability_zone      = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] default_group_type             = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] default_volume_type            = lvmdriver-1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] disk_geometry                  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] driver_client_cert             = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] driver_client_cert_key         = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] driver_data_namespace          = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] driver_ssl_cert_path           = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] driver_ssl_cert_verify         = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] driver_use_ssl                 = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] enable_force_upload            = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] enable_new_services            = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] enable_unsupported_driver      = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] enforce_multipath_for_image_xfer = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] filter_function                = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_api_insecure            = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_api_servers             = ['http://192.168.122.184/image'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_api_ssl_compression     = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_ca_certificates_file    = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_certfile                = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_keyfile                 = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_num_retries             = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance_request_timeout         = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] goodness_function              = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] graceful_shutdown_timeout      = 5 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] group_api_class                = cinder.group.api.API {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] host                           = devstack {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_compress_on_upload       = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_conversion_address_space_limit = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_conversion_cpu_limit     = 60 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_conversion_disable       = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_upload_use_cinder_backend = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_upload_use_internal_tenant = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_volume_cache_enabled     = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_volume_cache_max_count   = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] image_volume_cache_max_size_gb = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] init_host_max_objects_retrieval = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] iscsi_target_flags             =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] iscsi_write_cache              = on {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] iser_helper                    = tgtadm {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] iser_ip_address                = 192.168.122.184 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] iser_port                      = 3260 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] log_color                      = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] log_config_append              = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] log_dir                        = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] log_file                       = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] log_options                    = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] log_rotate_interval            = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] log_rotate_interval_type       = days {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] log_rotation_type              = none {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] max_age                        = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] max_logfile_count              = 30 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] max_logfile_size_mb            = 200 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] max_over_subscription_ratio    = 20.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] message_reap_interval          = 86400 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] message_ttl                    = 2592000 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72329]: INFO cinder.volume.manager [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] migration_create_volume_timeout_secs = 300 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] monkey_patch                   = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] monkey_patch_modules           = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] my_ip                          = 192.168.122.184 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] no_snapshot_gb_quota           = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] num_iser_scan_tries            = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] num_shell_tries                = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] num_volume_device_scan_tries   = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] nvmeof_conn_info_version       = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] nvmet_ns_id                    = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] nvmet_port_id                  = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] osapi_max_limit                = 1000 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] osapi_volume_ext_list          = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] osapi_volume_listen_port       = 8776 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] osapi_volume_use_ssl           = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] osapi_volume_workers           = 2 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] per_volume_size_limit          = -1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] periodic_fuzzy_delay           = 60 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] periodic_interval              = 60 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] public_endpoint                = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] publish_errors                 = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] quota_backup_gigabytes         = 1000 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] quota_backups                  = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] quota_gigabytes                = 1000 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] quota_groups                   = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] quota_snapshots                = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] quota_volumes                  = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] rate_limit_burst               = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] rate_limit_except_level        = CRITICAL {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] rate_limit_interval            = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] reinit_driver_count            = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] replication_device             = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] report_discard_supported       = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] report_interval                = 120 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] reservation_clean_interval     = 86400 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] reservation_expire             = 86400 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] reserved_image_namespaces      = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] reserved_percentage            = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] rpc_response_timeout           = 120 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] run_external_periodic_tasks    = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] scst_target_driver             = iscsi {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] scst_target_iqn_name           = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_down_time              = 720 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] shell_completion               = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] snapshot_name_template         = snapshot-%s {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] snapshot_same_host             = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] split_loggers                  = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] state_path                     = /opt/stack/data/cinder {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] storage_availability_zone      = nova {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] storage_protocol               = iSCSI {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] syslog_log_facility            = LOG_USER {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] target_helper                  = lioadm {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] target_ip_address              = 192.168.122.184 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] target_port                    = 3260 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] target_protocol                = iscsi {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] target_secondary_ip_addresses  = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] trace_flags                    = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] transport_url                  = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] until_refresh                  = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] use_chap_auth                  = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] use_default_quota_class        = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] use_journal                    = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] use_json                       = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] use_multipath_for_image_xfer   = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] use_stderr                     = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] use_syslog                     = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] verify_glance_signatures       = enabled {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_api_class               = cinder.volume.api.API {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_backend_name            = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_clear                   = zero {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_clear_ionice            = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_clear_size              = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_copy_bps_limit          = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_dd_blocksize            = 1M {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_name_template           = volume-%s {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_service_inithost_offload = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volume_usage_audit_period      = month {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] zoning_mode                    = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_concurrency.disable_process_locking = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.admin_password = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.admin_token = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.admin_user  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.auth_protocol = https {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.auth_section = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.auth_type   = password {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.auth_uri    = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.auth_version = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.cache       = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.certfile    = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.identity_uri = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.include_service_catalog = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.insecure    = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.interface   = public {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.keyfile     = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_password =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:20 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcache_username =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.region_name = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.service_type = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.184/identity {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.backend                  = dogpile.cache.null {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.backend_argument         = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.backend_expiration_time  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.config_prefix            = cache.oslo {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.debug_cache_backend      = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.enable_retry_client      = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.enable_socket_keepalive  = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.enabled                  = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.enforce_fips_mode        = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.expiration_time          = 600 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.hashclient_retry_attempts = 2 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.memcache_dead_retry      = 300 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.memcache_sasl_enabled    = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.password                 = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.proxies                  = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.redis_db                 = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.redis_server             = localhost:6379 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.retry_attempts           = 2 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.retry_delay              = 0.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.socket_keepalive_count   = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.socket_keepalive_idle    = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.socket_keepalive_interval = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.socket_timeout           = 1.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.tls_allowed_ciphers      = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.tls_cafile               = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.tls_certfile             = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.tls_enabled              = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.tls_keyfile              = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cache.username                 = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] coordination.backend_url       = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.asyncio_connection    = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.asyncio_slave_connection = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.backend               = sqlalchemy {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.connection            = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.connection_debug      = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.connection_parameters =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.connection_recycle_time = 3600 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.connection_trace      = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.db_inc_retry_interval = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.db_max_retries        = 20 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.db_max_retry_interval = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.db_retry_interval     = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.max_overflow          = 50 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.max_pool_size         = 5 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.max_retries           = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.mysql_wsrep_sync_wait = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.pool_timeout          = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.retry_interval        = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.slave_connection      = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.sqlite_synchronous    = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.synchronous_reader    = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] database.use_db_reconnect      = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.connection_string     = messaging:// {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.enabled               = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.es_doc_type           = notification {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.es_scroll_size        = 10000 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.es_scroll_time        = 2m {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.filter_error_trace    = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.hmac_keys             = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.sentinel_service_name = mymaster {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.socket_timeout        = 0.1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.trace_requests        = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler.trace_sqlalchemy      = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler_jaeger.process_tags   = {} {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler_jaeger.service_name_prefix = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] profiler_otlp.service_name_prefix = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.enforce_new_defaults = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: WARNING oslo_config.cfg [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.enforce_scope      = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.policy_default_rule = default {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] privsep_osbrick.group          = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] privsep_osbrick.helper_command = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] privsep_osbrick.user           = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cinder_sys_admin.group         = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cinder_sys_admin.helper_command = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] cinder_sys_admin.user          = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.auth_section      = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.auth_type         = password {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.cafile            = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.certfile          = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.collect_timing    = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.insecure          = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.keyfile           = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack sudo[72340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.send_service_user_token = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack sudo[72340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.split_loggers     = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] service_user.timeout           = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.auth_section            = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.auth_type               = password {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.certfile                = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.collect_timing          = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.insecure                = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.keyfile                 = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.region_name             = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.split_loggers           = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] glance.timeout                 = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.backend_availability_zone = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.chap_password = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.chap_username =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.disk_geometry = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.driver_client_cert = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.driver_client_cert_key = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.driver_data_namespace = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.driver_use_ssl = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.extra_capabilities = {} {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.filter_function = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.goodness_function = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.iscsi_target_flags =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.iscsi_write_cache = on {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.iser_ip_address = 192.168.122.184 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.iser_port     = 3260 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.lvm_share_target = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.lvm_type      = auto {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.num_shell_tries = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.replication_device = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.report_discard_supported = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.reserved_percentage = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.target_helper = tgtadm {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.target_ip_address = 192.168.122.184 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.target_port   = 3260 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.target_protocol = iscsi {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.trace_flags   = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.unique_fqdn_network = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.use_chap_auth = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volume_backend_name = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volume_clear  = zero {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volume_clear_ionice = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volume_clear_size = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_reports.file_event_handler = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_reports.log_dir           = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.backend_host       = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.chap_password      = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.chap_username      = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.disk_geometry      = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.driver_client_cert = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.extra_capabilities = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.filter_function    = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.goodness_function  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.iser_helper        = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.iser_port          = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.lvm_type           = auto {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.replication_device = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.report_discard_supported = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.reserved_percentage = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.scst_target_driver = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.storage_protocol   = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.target_ip_address  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.target_port        = 3260 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.trace_flags        = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volume_clear       = zero {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] lvmdriver-1.volumes_dir        = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_notifications.driver = [] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_notifications.retry = -1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] key_manager.fixed_key          = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.barbican_api_version  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.barbican_endpoint     = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.barbican_endpoint_type = public {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.barbican_region_name  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.cafile                = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.certfile              = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.collect_timing        = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.insecure              = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.keyfile               = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.number_of_retries     = 60 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.retry_delay           = 1 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.send_service_user_token = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.split_loggers         = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.timeout               = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.verify_ssl            = True {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican.verify_ssl_path       = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican_service_user.auth_section = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican_service_user.auth_type = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican_service_user.cafile   = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican_service_user.certfile = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican_service_user.collect_timing = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican_service_user.insecure = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican_service_user.keyfile  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican_service_user.split_loggers = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] barbican_service_user.timeout  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.approle_role_id          = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.approle_secret_id        = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.kv_mountpoint            = secret {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.kv_path                  = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.kv_version               = 2 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.namespace                = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.root_token_id            = **** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.ssl_ca_crt_file          = None {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.timeout                  = 60.0 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.use_ssl                  = False {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:22:20 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] ******************************************************************************** {{(pid=72222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 16:22:21 devstack sudo[72340]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:21 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:21 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:21 devstack sudo[72475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:22:21 devstack sudo[72475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:21 devstack sudo[72475]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:21 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.533s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:21 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:22:21 devstack cinder-volume[72329]: INFO cinder.brick.local_dev.lvm [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 15 16:22:21 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:21 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:21 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:21 devstack sudo[72699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 16:22:21 devstack sudo[72699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:22 devstack sudo[72699]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:22 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.548s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:22 devstack cinder-volume[72329]: DEBUG cinder.brick.local_dev.lvm [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72329) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 15 16:22:22 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:22 devstack sudo[72857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:22:22 devstack sudo[72857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:22 devstack sudo[72857]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:22 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.823s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:22 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:22 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:22 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:23 devstack sudo[72972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:22:23 devstack sudo[72972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:23 devstack sudo[72972]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:23 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:23 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:23 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:23 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:23 devstack sudo[73030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 15 16:22:23 devstack sudo[73030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:23 devstack sudo[73030]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:23 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.448s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:23 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:23 devstack sudo[73034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 16:22:23 devstack sudo[73034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:24 devstack sudo[73034]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:24 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:24 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:24 devstack sudo[73039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 16:22:24 devstack sudo[73039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:24 devstack sudo[73039]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:24 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:24 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:24 devstack sudo[73045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:22:24 devstack sudo[73045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:25 devstack sudo[73045]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:25 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:25 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:25 devstack sudo[73050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:22:25 devstack sudo[73050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:25 devstack sudo[73050]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:25 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:25 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:25 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:25 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:25 devstack sudo[73054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:22:25 devstack sudo[73054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:26 devstack sudo[73054]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:26 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:26 devstack cinder-volume[72329]: INFO cinder.volume.drivers.lvm [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 15 16:22:26 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:26 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:26 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:26 devstack sudo[73064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:22:26 devstack sudo[73064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:26 devstack sudo[73064]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:26 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:26 devstack cinder-volume[72329]: DEBUG cinder.volume.drivers.lvm [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Updating volume stats {{(pid=72329) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 16:22:26 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:26 devstack sudo[73180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 16:22:26 devstack sudo[73180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:27 devstack sudo[73180]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:27 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:27 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:27 devstack sudo[73184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:22:27 devstack sudo[73184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:27 devstack sudo[73184]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:27 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:27 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:27 devstack sudo[73323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:22:27 devstack sudo[73323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:28 devstack sudo[73323]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.469s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:28 devstack sudo[73326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:22:28 devstack sudo[73326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:28 devstack sudo[73326]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:28 devstack cinder-volume[72329]: INFO cinder.volume.driver [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG cinder.volume.driver [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72329) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG oslo_db.sqlalchemy.engines [None req-9622e62e-6174-40fe-984a-a107c082873a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG dbcounter [-] [72329] Writer thread running {{(pid=72329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG cinder.db.sqlalchemy.api [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Building query based on filter {{(pid=72329) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG cinder.image.image_utils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72329) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 16:22:28 devstack cinder-volume[72329]: INFO cinder.keymgr.migration [None req-2be63e3e-61d9-40e0-9beb-8e49786b0dfd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG cinder.volume.drivers.lvm [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Updating volume stats {{(pid=72329) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 16:22:28 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:28 devstack sudo[73341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 16:22:28 devstack sudo[73341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:29 devstack sudo[73341]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:29 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:29 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:29 devstack sudo[73344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:22:29 devstack sudo[73344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:29 devstack sudo[73344]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:29 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:29 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:29 devstack sudo[73347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:22:29 devstack sudo[73347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:30 devstack sudo[73347]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:30 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:30 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:30 devstack sudo[73352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:22:30 devstack sudo[73352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:30 devstack cinder-volume[72222]: DEBUG dbcounter [-] [72222] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72222) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:22:30 devstack sudo[73352]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:30 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:30 devstack cinder-volume[72329]: DEBUG cinder.manager [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Notifying Schedulers of capabilities ... {{(pid=72329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:22:30 devstack cinder-volume[72329]: INFO cinder.volume.manager [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Driver initialization completed successfully.
Apr 15 16:22:30 devstack cinder-volume[72329]: INFO cinder.manager [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Initiating service 2 cleanup
Apr 15 16:22:30 devstack cinder-volume[72329]: INFO cinder.manager [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Service 2 cleanup completed.
Apr 15 16:22:30 devstack cinder-volume[72329]: DEBUG cinder.service [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Creating RPC server for service cinder-volume {{(pid=72329) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 16:22:30 devstack cinder-volume[72329]: DEBUG cinder.service [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72329) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 16:22:30 devstack cinder-volume[72329]: INFO cinder.volume.manager [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 15 16:22:30 devstack cinder-volume[72329]: DEBUG cinder.volume.drivers.lvm [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Updating volume stats {{(pid=72329) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 16:22:30 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:30 devstack sudo[73361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 16:22:30 devstack sudo[73361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:31 devstack sudo[73361]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:31 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:31 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:31 devstack sudo[73398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:22:31 devstack sudo[73398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:31 devstack sudo[73398]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:31 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:31 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:31 devstack sudo[73455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:22:31 devstack sudo[73455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:32 devstack sudo[73455]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:32 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:32 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:22:32 devstack sudo[73458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:22:32 devstack sudo[73458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:22:32 devstack sudo[73458]: pam_unix(sudo:session): session closed for user root
Apr 15 16:22:32 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-9622e62e-6174-40fe-984a-a107c082873a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:22:32 devstack cinder-volume[72329]: INFO cinder.volume.manager [None req-9622e62e-6174-40fe-984a-a107c082873a None None] Driver post RPC initialization completed successfully.
Apr 15 16:22:38 devstack cinder-volume[72329]: DEBUG dbcounter [-] [72329] Writing DB stats cinder:SELECT=1 {{(pid=72329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:22:42 devstack cinder-volume[72329]: DEBUG dbcounter [-] [72329] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:23:48 devstack cinder-volume[72329]: DEBUG oslo_service.periodic_task [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72329) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:23:48 devstack cinder-volume[72329]: DEBUG cinder.volume.drivers.lvm [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Updating volume stats {{(pid=72329) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 16:23:48 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:23:48 devstack sudo[78309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 16:23:48 devstack sudo[78309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:23:48 devstack sudo[78309]: pam_unix(sudo:session): session closed for user root
Apr 15 16:23:48 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.408s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:23:48 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:23:49 devstack sudo[78313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:23:49 devstack sudo[78313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:23:49 devstack sudo[78313]: pam_unix(sudo:session): session closed for user root
Apr 15 16:23:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:23:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:23:49 devstack sudo[78317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:23:49 devstack sudo[78317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:23:49 devstack sudo[78317]: pam_unix(sudo:session): session closed for user root
Apr 15 16:23:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.418s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:23:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:23:49 devstack sudo[78321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:23:49 devstack sudo[78321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:23:50 devstack sudo[78321]: pam_unix(sudo:session): session closed for user root
Apr 15 16:23:50 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:23:50 devstack cinder-volume[72329]: DEBUG cinder.manager [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Notifying Schedulers of capabilities ... {{(pid=72329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:24:42 devstack cinder-volume[72329]: DEBUG dbcounter [-] [72329] Writing DB stats cinder:SELECT=1 {{(pid=72329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:24:42 devstack cinder-volume[72329]: DEBUG dbcounter [-] [72329] Writing DB stats cinder:UPDATE=1 {{(pid=72329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:24:48 devstack cinder-volume[72329]: DEBUG oslo_service.periodic_task [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72329) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:24:48 devstack cinder-volume[72329]: DEBUG cinder.volume.drivers.lvm [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Updating volume stats {{(pid=72329) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 16:24:48 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:24:48 devstack sudo[80221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 16:24:48 devstack sudo[80221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:24:49 devstack sudo[80221]: pam_unix(sudo:session): session closed for user root
Apr 15 16:24:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:24:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:24:49 devstack sudo[80227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:24:49 devstack sudo[80227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:24:49 devstack sudo[80227]: pam_unix(sudo:session): session closed for user root
Apr 15 16:24:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:24:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:24:49 devstack sudo[80230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 16:24:49 devstack sudo[80230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:24:49 devstack sudo[80230]: pam_unix(sudo:session): session closed for user root
Apr 15 16:24:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.411s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:24:49 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:24:49 devstack sudo[80234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 16:24:49 devstack sudo[80234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:24:50 devstack sudo[80234]: pam_unix(sudo:session): session closed for user root
Apr 15 16:24:50 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:24:50 devstack cinder-volume[72329]: DEBUG cinder.manager [None req-2ece389b-46cc-4a56-baa4-c31395f7aaf7 None None] Notifying Schedulers of capabilities ... {{(pid=72329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:25:42 devstack cinder-volume[72222]: INFO oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Caught SIGTERM, stopping children
Apr 15 16:25:42 devstack cinder-volume[72222]: DEBUG oslo_concurrency.lockutils [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Acquiring lock "singleton_lock" {{(pid=72222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 16:25:42 devstack cinder-volume[72222]: DEBUG oslo_concurrency.lockutils [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Acquired lock "singleton_lock" {{(pid=72222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 16:25:42 devstack cinder-volume[72222]: DEBUG oslo_concurrency.lockutils [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Releasing lock "singleton_lock" {{(pid=72222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 16:25:42 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Stop services. {{(pid=72222) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 16:25:42 devstack cinder-volume[72222]: DEBUG oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Killing children. {{(pid=72222) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 16:25:42 devstack cinder-volume[72222]: INFO oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Waiting on 1 children to exit
Apr 15 16:25:45 devstack cinder-volume[72329]: DEBUG oslo_concurrency.lockutils [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Acquiring lock "singleton_lock" {{(pid=72329) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 16:25:45 devstack cinder-volume[72329]: DEBUG oslo_concurrency.lockutils [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Acquired lock "singleton_lock" {{(pid=72329) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 16:25:45 devstack cinder-volume[72329]: DEBUG oslo_concurrency.lockutils [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Releasing lock "singleton_lock" {{(pid=72329) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 16:25:45 devstack cinder-volume[72329]: WARNING amqp [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 16:25:45 devstack cinder-volume[72329]: WARNING amqp [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 16:25:45 devstack cinder-volume[72222]: INFO oslo_service.backend._eventlet.service [None req-a9e0809c-6fee-47c3-91d2-fc751eb358f2 None None] Child 72329 exited with status 0
Apr 15 16:25:45 devstack cinder-volume[81650]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 16:25:45 devstack cinder-volume[81650]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 16:25:45 devstack cinder-volume[81650]: we strongly recommend against using it for new projects.
Apr 15 16:25:45 devstack cinder-volume[81650]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 16:25:45 devstack cinder-volume[81650]: framework.  For more detail see
Apr 15 16:25:45 devstack cinder-volume[81650]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 16:25:45 devstack cinder-volume[81650]:   import eventlet  # noqa
Apr 15 16:25:47 devstack cinder-volume[81650]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81650) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 16:25:47 devstack cinder-volume[81650]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81650) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 16:25:47 devstack cinder-volume[81650]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81650) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 16:25:48 devstack cinder-volume[81650]: INFO dbcounter [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Registered counter for database cinder
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_db.sqlalchemy.engines [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG dbcounter [-] [81650] Writer thread running {{(pid=81650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 16:25:48 devstack cinder-volume[81650]: INFO cinder.rpc [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 16:25:48 devstack cinder-volume[81650]: INFO cinder.rpc [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_db.sqlalchemy.engines [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:25:48 devstack cinder-volume[81650]: INFO cinder.volume.manager [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Determined volume DB was empty at startup.
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG cinder.volume.manager [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81650) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 16:25:48 devstack cinder-volume[81650]: INFO cinder.volume.manager [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 16:25:48 devstack cinder-volume[81650]: WARNING stevedore.named [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 16:25:48 devstack cinder-volume[81650]: WARNING castellan.key_manager [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 16:25:48 devstack cinder-volume[81650]: WARNING cinder.keymgr.conf_key_mgr [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 16:25:48 devstack cinder-volume[81650]: INFO cinder.volume.manager [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_db.sqlalchemy.engines [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:25:48 devstack cinder-volume[81650]: INFO oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Starting 1 workers
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Started child 81769 {{(pid=81650) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Full set of CONF: {{(pid=81650) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] ******************************************************************************** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Configuration options gathered from: {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] ================================================================================ {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] allow_availability_zone_fallback = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] allow_compression_on_image_upload = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] allowed_direct_url_schemes     = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] api_rate_limit                 = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] auth_strategy                  = keystone {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_availability_zone      = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_host                   = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_name                   = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_stats_polling_interval = 60 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backup_api_class               = cinder.backup.api.API {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backup_name_template           = backup-%s {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backup_use_same_host           = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backup_use_temp_snapshot       = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] chap_password                  = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] chap_username                  =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cinder_internal_tenant_project_id = b13b5c06cf4d4854b053663a716acd21 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cinder_internal_tenant_user_id = 5beebd9c16294f388f6cff68c00f8900 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cluster                        = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] compression_format             = gzip {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] compute_api_class              = cinder.compute.nova.API {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] config_dir                     = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] config_source                  = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] control_exchange               = openstack {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] debug                          = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] default_availability_zone      = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] default_group_type             = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] default_volume_type            = QuobyteHD {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] disk_geometry                  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] driver_client_cert             = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81769]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] driver_client_cert_key         = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] driver_data_namespace          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] driver_ssl_cert_path           = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] driver_ssl_cert_verify         = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] driver_use_ssl                 = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] enable_new_services            = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] enable_unsupported_driver      = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] enabled_backends               = ['QuobyteHD'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] enforce_multipath_for_image_xfer = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] filter_function                = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_api_insecure            = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_api_servers             = ['http://192.168.122.184/image'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_api_ssl_compression     = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_ca_certificates_file    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_catalog_info            = image:glance:publicURL {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_certfile                = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_keyfile                 = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_num_retries             = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance_request_timeout         = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] goodness_function              = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] graceful_shutdown_timeout      = 5 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] group_api_class                = cinder.group.api.API {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] host                           = devstack {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_compress_on_upload       = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_conversion_address_space_limit = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_conversion_cpu_limit     = 60 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_conversion_disable       = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_upload_use_cinder_backend = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_upload_use_internal_tenant = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_volume_cache_enabled     = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_volume_cache_max_count   = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] image_volume_cache_max_size_gb = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] init_host_max_objects_retrieval = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] instance_format                = [instance: %(uuid)s]  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] iscsi_target_flags             =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] iscsi_write_cache              = on {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] iser_helper                    = tgtadm {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] iser_ip_address                = 192.168.122.184 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] iser_port                      = 3260 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] log_color                      = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] log_config_append              = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] log_dir                        = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] log_file                       = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] log_options                    = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] log_rotate_interval            = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] log_rotate_interval_type       = days {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] log_rotation_type              = none {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] max_age                        = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] max_logfile_count              = 30 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] max_logfile_size_mb            = 200 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] max_over_subscription_ratio    = 20.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] message_reap_interval          = 86400 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] message_ttl                    = 2592000 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] migration_create_volume_timeout_secs = 300 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] monkey_patch                   = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] monkey_patch_modules           = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] my_ip                          = 192.168.122.184 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] no_snapshot_gb_quota           = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] num_iser_scan_tries            = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] num_shell_tries                = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] num_volume_device_scan_tries   = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] nvmeof_conn_info_version       = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] nvmet_ns_id                    = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] nvmet_port_id                  = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] osapi_max_limit                = 1000 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] osapi_volume_ext_list          = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] osapi_volume_listen_port       = 8776 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] osapi_volume_use_ssl           = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] osapi_volume_workers           = 2 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] per_volume_size_limit          = -1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] periodic_fuzzy_delay           = 60 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] periodic_interval              = 60 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] public_endpoint                = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] publish_errors                 = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] quota_backup_gigabytes         = 1000 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] quota_backups                  = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] quota_gigabytes                = 1000 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] quota_groups                   = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] quota_snapshots                = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81769]: INFO cinder.volume.manager [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] quota_volumes                  = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.remotefs [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81769) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] rate_limit_burst               = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] rate_limit_except_level        = CRITICAL {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] rate_limit_interval            = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] reinit_driver_count            = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] replication_device             = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] report_discard_supported       = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] report_interval                = 120 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] reservation_clean_interval     = 86400 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] reservation_expire             = 86400 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] reserved_image_namespaces      = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] reserved_percentage            = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] rpc_response_timeout           = 120 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] run_external_periodic_tasks    = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] scst_target_driver             = iscsi {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] scst_target_iqn_name           = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_down_time              = 720 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] shell_completion               = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] snapshot_name_template         = snapshot-%s {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] split_loggers                  = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] state_path                     = /opt/stack/data/cinder {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] storage_availability_zone      = nova {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] storage_protocol               = iSCSI {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] syslog_log_facility            = LOG_USER {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] target_helper                  = lioadm {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] target_ip_address              = 192.168.122.184 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] target_port                    = 3260 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] target_protocol                = iscsi {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] target_secondary_ip_addresses  = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] trace_flags                    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] transport_url                  = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] until_refresh                  = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] use_chap_auth                  = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] use_default_quota_class        = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] use_journal                    = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] use_json                       = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] use_multipath_for_image_xfer   = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] use_stderr                     = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] use_syslog                     = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] verify_glance_signatures       = enabled {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_api_class               = cinder.volume.api.API {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_backend_name            = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_clear                   = zero {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_clear_ionice            = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_clear_size              = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_copy_bps_limit          = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_dd_blocksize            = 1M {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_name_template           = volume-%s {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_service_inithost_offload = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volume_usage_audit_period      = month {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] zoning_mode                    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_concurrency.disable_process_locking = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.admin_password = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.admin_token = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.admin_user  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.auth_port   = 35357 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.auth_protocol = https {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.auth_section = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.auth_type   = password {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.auth_uri    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.auth_version = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.cache       = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.certfile    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.delay_auth_decision = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.http_connect_timeout = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.identity_uri = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.include_service_catalog = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.insecure    = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.interface   = public {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.keyfile     = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_password =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcache_username =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.region_name = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.service_token_roles_required = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.service_type = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.token_cache_time = 300 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.184/identity {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.backend                  = dogpile.cache.null {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.backend_argument         = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.backend_expiration_time  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.config_prefix            = cache.oslo {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.debug_cache_backend      = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.enable_retry_client      = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.enable_socket_keepalive  = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.enabled                  = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.enforce_fips_mode        = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.expiration_time          = 600 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.hashclient_retry_attempts = 2 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.memcache_dead_retry      = 300 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.memcache_pool_maxsize    = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.memcache_sasl_enabled    = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.password                 = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.proxies                  = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.redis_db                 = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.redis_sentinel_service_name = mymaster {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.redis_server             = localhost:6379 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.retry_attempts           = 2 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.retry_delay              = 0.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.socket_keepalive_count   = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.socket_keepalive_idle    = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.socket_keepalive_interval = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.socket_timeout           = 1.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.tls_allowed_ciphers      = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.tls_cafile               = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.tls_certfile             = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.tls_enabled              = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.tls_keyfile              = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cache.username                 = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] coordination.backend_url       = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.asyncio_connection    = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.asyncio_slave_connection = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.backend               = sqlalchemy {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.connection            = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.connection_debug      = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.connection_parameters =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.connection_recycle_time = 3600 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.connection_trace      = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.db_inc_retry_interval = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.db_max_retries        = 20 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.db_max_retry_interval = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.db_retry_interval     = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.max_overflow          = 50 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.max_pool_size         = 5 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.max_retries           = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.mysql_wsrep_sync_wait = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.pool_timeout          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.retry_interval        = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.slave_connection      = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.sqlite_synchronous    = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.synchronous_reader    = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] database.use_db_reconnect      = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.connection_string     = messaging:// {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.enabled               = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.es_doc_type           = notification {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.es_scroll_size        = 10000 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.es_scroll_time        = 2m {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.filter_error_trace    = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.hmac_keys             = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.sentinel_service_name = mymaster {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.socket_timeout        = 0.1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.trace_requests        = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler.trace_sqlalchemy      = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler_jaeger.process_tags   = {} {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler_jaeger.service_name_prefix = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] profiler_otlp.service_name_prefix = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.enforce_new_defaults = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: WARNING oslo_config.cfg [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 16:25:48 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81769) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.enforce_scope      = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81769]: WARNING cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.policy_default_rule = default {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81769]: WARNING cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.policy_file        = policy.yaml {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Running cmd (subprocess): mount.quobyte {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] privsep_osbrick.group          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] privsep_osbrick.helper_command = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] privsep_osbrick.user           = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cinder_sys_admin.group         = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cinder_sys_admin.helper_command = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] cinder_sys_admin.user          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.auth_section      = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.auth_type         = password {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.cafile            = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.certfile          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.collect_timing    = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.insecure          = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.keyfile           = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.send_service_user_token = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.split_loggers     = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] service_user.timeout           = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.auth_section            = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.auth_type               = password {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.certfile                = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.collect_timing          = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.insecure                = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.keyfile                 = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.region_name             = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.split_loggers           = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] glance.timeout                 = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.backend_availability_zone = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.chap_password = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.chap_username =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.disk_geometry = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.driver_client_cert = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.driver_client_cert_key = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.driver_data_namespace = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.driver_use_ssl = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.enable_unsupported_driver = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.extra_capabilities = {} {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.filter_function = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.goodness_function = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.iscsi_target_flags =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.iscsi_write_cache = on {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.iser_helper   = tgtadm {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.iser_ip_address = 192.168.122.184 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.iser_port     = 3260 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_host      =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_login     = admin {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_mount_options = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_password  = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_private_key =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_share_path =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.num_shell_tries = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.nvmet_port_id = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.quobyte_client_cfg = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.quobyte_volume_url = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.replication_device = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.report_discard_supported = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.reserved_percentage = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.scst_target_driver = iscsi {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.scst_target_iqn_name = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.storage_protocol = iSCSI {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.target_helper = tgtadm {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.target_ip_address = 192.168.122.184 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.target_port   = 3260 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.target_protocol = iscsi {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.trace_flags   = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.unique_fqdn_network = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.use_chap_auth = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.volume_backend_name = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.volume_clear  = zero {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.volume_clear_ionice = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.volume_clear_size = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_reports.file_event_handler = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_reports.log_dir           = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.backend_availability_zone = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.backend_host         = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.chap_password        = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.chap_username        = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.chiscsi_conf         = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.disk_geometry        = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.driver_client_cert   = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.driver_client_cert_key = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.driver_data_namespace = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.driver_use_ssl       = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.extra_capabilities   = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.filter_function      = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.goodness_function    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.iser_helper          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.iser_ip_address      = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.iser_port            = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.iser_target_prefix   = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_host             = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_login            = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_mount_options    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_password         = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_private_key      = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_share_path       = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_ssh_port         = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.num_shell_tries      = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.nvmet_port_id        = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.replication_device   = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.report_discard_supported = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.reserved_percentage  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.scst_target_driver   = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.storage_protocol     = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.target_helper        = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.target_ip_address    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.target_port          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.target_prefix        = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.target_protocol      = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.trace_flags          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.use_chap_auth        = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.volume_clear         = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.volume_clear_size    = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] QuobyteHD.volumes_dir          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.ssl      = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_notifications.driver = [] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_notifications.retry = -1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] oslo_messaging_notifications.transport_url = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] key_manager.fixed_key          = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.barbican_api_version  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.barbican_endpoint     = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.barbican_endpoint_type = public {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.barbican_region_name  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.cafile                = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.certfile              = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.collect_timing        = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.insecure              = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.keyfile               = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.number_of_retries     = 60 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.retry_delay           = 1 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.send_service_user_token = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.split_loggers         = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.timeout               = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.verify_ssl            = True {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican.verify_ssl_path       = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican_service_user.auth_section = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican_service_user.auth_type = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican_service_user.cafile   = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican_service_user.certfile = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican_service_user.collect_timing = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican_service_user.insecure = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican_service_user.keyfile  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican_service_user.split_loggers = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] barbican_service_user.timeout  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.approle_role_id          = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.approle_secret_id        = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.kv_mountpoint            = secret {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.kv_path                  = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.kv_version               = 2 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.namespace                = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.root_token_id            = **** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.ssl_ca_crt_file          = None {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.timeout                  = 60.0 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.use_ssl                  = False {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:25:48 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] ******************************************************************************** {{(pid=81650) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 16:25:48 devstack quobyte-client[81773]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 16:25:48 devstack quobyte-client[81773]: Invalid parameters found, error: missing mount point.
Apr 15 16:25:48 devstack quobyte-client[81773]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 16:25:48 devstack quobyte-client[81773]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 16:25:48 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:25:48 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:25:48 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:25:48 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=81769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:25:48 devstack cinder-volume[81769]: INFO cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 ...
Apr 15 16:25:48 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 -c /etc/quobyte/client-cinder.cfg {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:25:48 devstack sudo[81774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 -c /etc/quobyte/client-cinder.cfg
Apr 15 16:25:48 devstack sudo[81774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:25:49 devstack sudo[81774]: pam_unix(sudo:session): session closed for user root
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.492s {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:25:49 devstack cinder-volume[81769]: INFO cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 succeeded
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=81769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.498s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:25:49 devstack sudo[81843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:25:49 devstack sudo[81843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:25:49 devstack sudo[81843]: pam_unix(sudo:session): session closed for user root
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.410s {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:25:49 devstack cinder-volume[81769]: INFO cinder.volume.driver [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG cinder.volume.driver [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7265281677246, 'free_capacity_gb': 1775.7265281677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81769) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG oslo_db.sqlalchemy.engines [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG dbcounter [-] [81769] Writer thread running {{(pid=81769) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG cinder.db.sqlalchemy.api [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Building query based on filter {{(pid=81769) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG cinder.image.image_utils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81769) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 16:25:49 devstack cinder-volume[81769]: INFO cinder.keymgr.migration [None req-27c25d96-3ecc-4c61-9851-81f72e8cd766 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=81769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=81769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:25:49 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:25:49 devstack sudo[81846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:25:49 devstack sudo[81846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:25:50 devstack sudo[81846]: pam_unix(sudo:session): session closed for user root
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.412s {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG cinder.manager [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Notifying Schedulers of capabilities ... {{(pid=81769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:25:50 devstack cinder-volume[81769]: INFO cinder.volume.manager [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Driver initialization completed successfully.
Apr 15 16:25:50 devstack cinder-volume[81769]: INFO cinder.manager [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Initiating service 3 cleanup
Apr 15 16:25:50 devstack cinder-volume[81769]: INFO cinder.manager [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Service 3 cleanup completed.
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG cinder.service [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Creating RPC server for service cinder-volume {{(pid=81769) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG cinder.service [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81769) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 16:25:50 devstack cinder-volume[81769]: INFO cinder.volume.manager [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=81769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=81769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:25:50 devstack sudo[81851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:25:50 devstack sudo[81851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:25:50 devstack sudo[81851]: pam_unix(sudo:session): session closed for user root
Apr 15 16:25:50 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.485s {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:25:50 devstack cinder-volume[81769]: INFO cinder.volume.manager [None req-93645fed-0f96-4f74-8d86-daec810a87d9 None None] Driver post RPC initialization completed successfully.
Apr 15 16:25:53 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-b55d0b2e-a79a-4583-84d6-681bb1860aeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:25:53 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-b55d0b2e-a79a-4583-84d6-681bb1860aeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:25:53 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-b55d0b2e-a79a-4583-84d6-681bb1860aeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=81769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:25:53 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-b55d0b2e-a79a-4583-84d6-681bb1860aeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=81769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:25:53 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-b55d0b2e-a79a-4583-84d6-681bb1860aeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:25:53 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-b55d0b2e-a79a-4583-84d6-681bb1860aeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:25:53 devstack sudo[81916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:25:53 devstack sudo[81916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:25:54 devstack sudo[81916]: pam_unix(sudo:session): session closed for user root
Apr 15 16:25:54 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-b55d0b2e-a79a-4583-84d6-681bb1860aeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.404s {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:25:54 devstack cinder-volume[81769]: DEBUG cinder.manager [None req-b55d0b2e-a79a-4583-84d6-681bb1860aeb None None] Notifying Schedulers of capabilities ... {{(pid=81769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:25:57 devstack cinder-volume[81650]: INFO oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Caught SIGTERM, stopping children
Apr 15 16:25:57 devstack cinder-volume[81650]: DEBUG oslo_concurrency.lockutils [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Acquiring lock "singleton_lock" {{(pid=81650) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 16:25:57 devstack cinder-volume[81650]: DEBUG oslo_concurrency.lockutils [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Acquired lock "singleton_lock" {{(pid=81650) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 16:25:57 devstack cinder-volume[81650]: DEBUG oslo_concurrency.lockutils [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Releasing lock "singleton_lock" {{(pid=81650) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 16:25:57 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Stop services. {{(pid=81650) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 16:25:57 devstack cinder-volume[81650]: DEBUG oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Killing children. {{(pid=81650) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 16:25:57 devstack cinder-volume[81650]: INFO oslo_service.backend._eventlet.service [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Waiting on 1 children to exit
Apr 15 16:26:00 devstack cinder-volume[81769]: DEBUG dbcounter [-] [81769] Writing DB stats cinder:SELECT=4 {{(pid=81769) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:26:00 devstack cinder-volume[81769]: DEBUG dbcounter [-] [81769] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=81769) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:26:01 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-be00ef0b-24b7-45a7-911f-f9c346b4d9e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:26:01 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-be00ef0b-24b7-45a7-911f-f9c346b4d9e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:26:01 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-be00ef0b-24b7-45a7-911f-f9c346b4d9e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=81769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:26:01 devstack cinder-volume[81769]: DEBUG cinder.volume.drivers.quobyte [None req-be00ef0b-24b7-45a7-911f-f9c346b4d9e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=81769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:26:01 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-be00ef0b-24b7-45a7-911f-f9c346b4d9e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81769) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:26:01 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-be00ef0b-24b7-45a7-911f-f9c346b4d9e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:26:01 devstack sudo[82009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:26:01 devstack sudo[82009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:26:02 devstack sudo[82009]: pam_unix(sudo:session): session closed for user root
Apr 15 16:26:02 devstack cinder-volume[81769]: DEBUG oslo_concurrency.processutils [None req-be00ef0b-24b7-45a7-911f-f9c346b4d9e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.686s {{(pid=81769) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:26:02 devstack cinder-volume[81769]: DEBUG cinder.manager [None req-be00ef0b-24b7-45a7-911f-f9c346b4d9e0 None None] Notifying Schedulers of capabilities ... {{(pid=81769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:26:02 devstack cinder-volume[81769]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Apr 15 16:26:02 devstack cinder-volume[82021]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 16:26:02 devstack cinder-volume[82021]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 16:26:02 devstack cinder-volume[82021]: we strongly recommend against using it for new projects.
Apr 15 16:26:02 devstack cinder-volume[82021]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 16:26:02 devstack cinder-volume[82021]: framework.  For more detail see
Apr 15 16:26:02 devstack cinder-volume[82021]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 16:26:02 devstack cinder-volume[82021]:   import eventlet  # noqa
Apr 15 16:26:03 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Acquiring lock "singleton_lock" {{(pid=81769) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 16:26:03 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Acquired lock "singleton_lock" {{(pid=81769) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 16:26:03 devstack cinder-volume[81769]: DEBUG oslo_concurrency.lockutils [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Releasing lock "singleton_lock" {{(pid=81769) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 16:26:03 devstack cinder-volume[81769]: WARNING amqp [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 16:26:03 devstack cinder-volume[81769]: WARNING amqp [None req-a09efd1b-b517-45bb-9ce2-c44be905c41e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 16:26:04 devstack cinder-volume[82021]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 16:26:04 devstack cinder-volume[82021]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 16:26:04 devstack cinder-volume[82021]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 16:26:04 devstack cinder-volume[82021]: INFO dbcounter [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Registered counter for database cinder
Apr 15 16:26:04 devstack cinder-volume[82021]: DEBUG oslo_db.sqlalchemy.engines [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG dbcounter [-] [82021] Writer thread running {{(pid=82021) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 16:26:05 devstack cinder-volume[82021]: INFO cinder.rpc [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 16:26:05 devstack cinder-volume[82021]: INFO cinder.rpc [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_db.sqlalchemy.engines [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:26:05 devstack cinder-volume[82021]: INFO cinder.volume.manager [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Determined volume DB was empty at startup.
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG cinder.volume.manager [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82021) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 16:26:05 devstack cinder-volume[82021]: WARNING stevedore.named [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 16:26:05 devstack cinder-volume[82021]: WARNING castellan.key_manager [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 16:26:05 devstack cinder-volume[82021]: WARNING cinder.keymgr.conf_key_mgr [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 16:26:05 devstack cinder-volume[82021]: INFO cinder.volume.manager [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_db.sqlalchemy.engines [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:26:05 devstack cinder-volume[82021]: INFO oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Starting 1 workers
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Started child 82156 {{(pid=82021) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Full set of CONF: {{(pid=82021) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] ******************************************************************************** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Configuration options gathered from: {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] ================================================================================ {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] allow_availability_zone_fallback = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] allow_compression_on_image_upload = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] allowed_direct_url_schemes     = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] api_rate_limit                 = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82156]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] auth_strategy                  = keystone {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_availability_zone      = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_host                   = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_name                   = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_stats_polling_interval = 60 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backup_api_class               = cinder.backup.api.API {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backup_name_template           = backup-%s {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backup_use_same_host           = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backup_use_temp_snapshot       = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] chap_password                  = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] chap_username                  =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cinder_internal_tenant_project_id = b13b5c06cf4d4854b053663a716acd21 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cinder_internal_tenant_user_id = 5beebd9c16294f388f6cff68c00f8900 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cluster                        = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] compression_format             = gzip {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] config_dir                     = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] config_source                  = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] control_exchange               = openstack {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] debug                          = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] default_availability_zone      = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] default_group_type             = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] default_volume_type            = QuobyteHD {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] disk_geometry                  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] driver_client_cert             = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] driver_client_cert_key         = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] driver_data_namespace          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] driver_ssl_cert_path           = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] driver_ssl_cert_verify         = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] driver_use_ssl                 = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] enable_new_services            = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] enable_unsupported_driver      = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] enforce_multipath_for_image_xfer = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] filter_function                = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_api_insecure            = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_api_servers             = ['http://192.168.122.184/image'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_api_ssl_compression     = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_ca_certificates_file    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_certfile                = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_keyfile                 = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_num_retries             = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance_request_timeout         = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] goodness_function              = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] graceful_shutdown_timeout      = 5 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] group_api_class                = cinder.group.api.API {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] host                           = devstack {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_compress_on_upload       = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_conversion_address_space_limit = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_conversion_cpu_limit     = 60 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_conversion_disable       = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_upload_use_cinder_backend = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_upload_use_internal_tenant = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_volume_cache_enabled     = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_volume_cache_max_count   = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] image_volume_cache_max_size_gb = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] init_host_max_objects_retrieval = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] iscsi_target_flags             =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82156) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] iscsi_write_cache              = on {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] iser_helper                    = tgtadm {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] iser_ip_address                = 192.168.122.184 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] iser_port                      = 3260 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] log_color                      = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] log_config_append              = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] log_dir                        = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] log_file                       = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] log_options                    = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] log_rotate_interval            = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] log_rotate_interval_type       = days {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] log_rotation_type              = none {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] max_age                        = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] max_logfile_count              = 30 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] max_logfile_size_mb            = 200 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] max_over_subscription_ratio    = 20.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] message_reap_interval          = 86400 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] message_ttl                    = 2592000 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] migration_create_volume_timeout_secs = 300 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] monkey_patch                   = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] monkey_patch_modules           = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] my_ip                          = 192.168.122.184 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] no_snapshot_gb_quota           = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] num_iser_scan_tries            = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] num_shell_tries                = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] num_volume_device_scan_tries   = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] nvmeof_conn_info_version       = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] nvmet_ns_id                    = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] nvmet_port_id                  = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] osapi_max_limit                = 1000 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] osapi_volume_ext_list          = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] osapi_volume_listen_port       = 8776 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] osapi_volume_use_ssl           = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] osapi_volume_workers           = 2 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] per_volume_size_limit          = -1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] periodic_fuzzy_delay           = 60 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] periodic_interval              = 60 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] public_endpoint                = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] publish_errors                 = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] quota_backup_gigabytes         = 1000 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] quota_backups                  = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] quota_gigabytes                = 1000 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] quota_groups                   = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] quota_snapshots                = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] quota_volumes                  = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] rate_limit_burst               = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] rate_limit_except_level        = CRITICAL {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] rate_limit_interval            = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] reinit_driver_count            = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] replication_device             = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] report_discard_supported       = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] report_interval                = 120 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] reservation_clean_interval     = 86400 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] reservation_expire             = 86400 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] reserved_image_namespaces      = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] reserved_percentage            = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] rpc_response_timeout           = 120 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] run_external_periodic_tasks    = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] scst_target_driver             = iscsi {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] scst_target_iqn_name           = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_down_time              = 720 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] shell_completion               = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] snapshot_name_template         = snapshot-%s {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] split_loggers                  = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] state_path                     = /opt/stack/data/cinder {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] storage_availability_zone      = nova {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] storage_protocol               = iSCSI {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] syslog_log_facility            = LOG_USER {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] target_helper                  = lioadm {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] target_ip_address              = 192.168.122.184 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] target_port                    = 3260 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] target_protocol                = iscsi {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] target_secondary_ip_addresses  = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] trace_flags                    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] transport_url                  = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] until_refresh                  = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] use_chap_auth                  = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] use_default_quota_class        = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] use_journal                    = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] use_json                       = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] use_multipath_for_image_xfer   = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] use_stderr                     = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] use_syslog                     = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] verify_glance_signatures       = enabled {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_api_class               = cinder.volume.api.API {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_backend_name            = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_clear                   = zero {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_clear_ionice            = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_clear_size              = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82156) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_copy_bps_limit          = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.quobyte [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 16:26:05 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.quobyte [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_dd_blocksize            = 1M {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_name_template           = volume-%s {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_service_inithost_offload = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volume_usage_audit_period      = month {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Running cmd (subprocess): mount.quobyte {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] zoning_mode                    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_concurrency.disable_process_locking = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.admin_password = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.admin_token = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.admin_user  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.auth_protocol = https {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.auth_section = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.auth_type   = password {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.auth_uri    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.auth_version = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.cache       = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.certfile    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.identity_uri = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.include_service_catalog = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.insecure    = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.interface   = public {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.keyfile     = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_password =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcache_username =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.region_name = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.service_type = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.184/identity {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.backend                  = dogpile.cache.null {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.backend_argument         = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.backend_expiration_time  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.config_prefix            = cache.oslo {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.debug_cache_backend      = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.enable_retry_client      = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.enable_socket_keepalive  = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.enabled                  = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.enforce_fips_mode        = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.expiration_time          = 600 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.hashclient_retry_attempts = 2 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.memcache_dead_retry      = 300 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.memcache_sasl_enabled    = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.password                 = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.proxies                  = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.redis_db                 = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.redis_server             = localhost:6379 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.retry_attempts           = 2 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.retry_delay              = 0.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.socket_keepalive_count   = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.socket_keepalive_idle    = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.socket_keepalive_interval = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.socket_timeout           = 1.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.tls_allowed_ciphers      = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.tls_cafile               = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.tls_certfile             = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.tls_enabled              = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.tls_keyfile              = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cache.username                 = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] coordination.backend_url       = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.asyncio_connection    = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.asyncio_slave_connection = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.backend               = sqlalchemy {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.connection            = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.connection_debug      = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.connection_parameters =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.connection_recycle_time = 3600 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.connection_trace      = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.db_inc_retry_interval = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.db_max_retries        = 20 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.db_max_retry_interval = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.db_retry_interval     = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.max_overflow          = 50 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.max_pool_size         = 5 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.max_retries           = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.mysql_wsrep_sync_wait = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.pool_timeout          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.retry_interval        = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.slave_connection      = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.sqlite_synchronous    = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.synchronous_reader    = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] database.use_db_reconnect      = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.connection_string     = messaging:// {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.enabled               = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.es_doc_type           = notification {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.es_scroll_size        = 10000 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.es_scroll_time        = 2m {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.filter_error_trace    = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.hmac_keys             = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.sentinel_service_name = mymaster {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.socket_timeout        = 0.1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.trace_requests        = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler.trace_sqlalchemy      = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler_jaeger.process_tags   = {} {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler_jaeger.service_name_prefix = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] profiler_otlp.service_name_prefix = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.enforce_new_defaults = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: WARNING oslo_config.cfg [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.enforce_scope      = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.policy_default_rule = default {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] privsep_osbrick.group          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] privsep_osbrick.helper_command = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] privsep_osbrick.user           = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cinder_sys_admin.group         = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cinder_sys_admin.helper_command = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] cinder_sys_admin.user          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.auth_section      = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.auth_type         = password {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack quobyte-client[82161]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 16:26:05 devstack quobyte-client[82161]: Invalid parameters found, error: missing mount point.
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.cafile            = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack quobyte-client[82161]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 16:26:05 devstack quobyte-client[82161]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.certfile          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.collect_timing    = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.insecure          = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.keyfile           = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.send_service_user_token = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.split_loggers     = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] service_user.timeout           = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.auth_section            = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.auth_type               = password {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.certfile                = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.collect_timing          = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.insecure                = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.keyfile                 = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.region_name             = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.split_loggers           = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] glance.timeout                 = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.backend_availability_zone = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.chap_password = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.chap_username =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.disk_geometry = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.driver_client_cert = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.driver_client_cert_key = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.driver_data_namespace = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.driver_use_ssl = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.extra_capabilities = {} {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.filter_function = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.goodness_function = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.iscsi_target_flags =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.iscsi_write_cache = on {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.iser_ip_address = 192.168.122.184 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.iser_port     = 3260 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_host      =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_login     = admin {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_mount_options = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_password  = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_private_key =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_share_path =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.num_shell_tries = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack sudo[82171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:26:05 devstack sudo[82171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.quobyte_volume_url = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.replication_device = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.report_discard_supported = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.reserved_percentage = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.target_helper = tgtadm {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.target_ip_address = 192.168.122.184 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.target_port   = 3260 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.target_protocol = iscsi {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.trace_flags   = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.unique_fqdn_network = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.use_chap_auth = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.volume_backend_name = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.volume_clear  = zero {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.volume_clear_ionice = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.volume_clear_size = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_reports.file_event_handler = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_reports.log_dir           = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.backend_availability_zone = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.backend_host         = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.chap_password        = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.chap_username        = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.disk_geometry        = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.driver_client_cert   = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.driver_data_namespace = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.extra_capabilities   = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.filter_function      = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.goodness_function    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.iser_helper          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.iser_ip_address      = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.iser_port            = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_host             = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_login            = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_mount_options    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_password         = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_private_key      = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_share_path       = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.num_shell_tries      = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.replication_device   = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.report_discard_supported = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.reserved_percentage  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.scst_target_driver   = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.storage_protocol     = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.target_helper        = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.target_ip_address    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.target_port          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.target_prefix        = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.target_protocol      = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.trace_flags          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.use_chap_auth        = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.volume_clear         = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.volume_clear_size    = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] QuobyteHD.volumes_dir          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_notifications.driver = [] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_notifications.retry = -1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] key_manager.fixed_key          = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.barbican_api_version  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.barbican_endpoint     = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.barbican_endpoint_type = public {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.barbican_region_name  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.cafile                = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.certfile              = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.collect_timing        = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.insecure              = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.keyfile               = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.number_of_retries     = 60 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.retry_delay           = 1 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.send_service_user_token = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.split_loggers         = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.timeout               = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.verify_ssl            = True {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican.verify_ssl_path       = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican_service_user.auth_section = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican_service_user.auth_type = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican_service_user.cafile   = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican_service_user.certfile = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican_service_user.collect_timing = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican_service_user.insecure = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican_service_user.keyfile  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican_service_user.split_loggers = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] barbican_service_user.timeout  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.approle_role_id          = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.approle_secret_id        = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.kv_mountpoint            = secret {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.kv_path                  = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.kv_version               = 2 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.namespace                = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.root_token_id            = **** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.ssl_ca_crt_file          = None {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.timeout                  = 60.0 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.use_ssl                  = False {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 16:26:05 devstack cinder-volume[82021]: DEBUG oslo_service.backend._eventlet.service [None req-f351f62d-1dba-4526-ba2d-dc14aa528933 None None] ******************************************************************************** {{(pid=82021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 16:26:05 devstack sudo[82171]: pam_unix(sudo:session): session closed for user root
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.426s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:26:05 devstack cinder-volume[82156]: INFO cinder.volume.driver [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG cinder.volume.driver [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7265281677246, 'free_capacity_gb': 1775.7265281677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82156) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_db.sqlalchemy.engines [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writer thread running {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG cinder.db.sqlalchemy.api [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Building query based on filter {{(pid=82156) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82156) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:26:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:26:05 devstack cinder-volume[82156]: INFO cinder.keymgr.migration [None req-580c28d7-a09e-4fab-896f-30461161eba4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 16:26:05 devstack sudo[82223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:26:05 devstack sudo[82223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:26:06 devstack sudo[82223]: pam_unix(sudo:session): session closed for user root
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.408s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:26:06 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Driver initialization completed successfully.
Apr 15 16:26:06 devstack cinder-volume[82156]: INFO cinder.manager [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Initiating service 3 cleanup
Apr 15 16:26:06 devstack cinder-volume[82156]: INFO cinder.manager [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Service 3 cleanup completed.
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG cinder.service [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Creating RPC server for service cinder-volume {{(pid=82156) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG cinder.service [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82156) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 16:26:06 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:26:06 devstack sudo[82249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:26:06 devstack sudo[82249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:26:06 devstack sudo[82249]: pam_unix(sudo:session): session closed for user root
Apr 15 16:26:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.400s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:26:06 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b263e937-5da2-4fd6-8b99-f9c0572a1980 None None] Driver post RPC initialization completed successfully.
Apr 15 16:26:15 devstack cinder-volume[82021]: DEBUG dbcounter [-] [82021] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82021) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:26:16 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=3 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:26:16 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:27:02 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b70adfb4-3074-45a1-9993-070e7913fa4f tempest-GroupsV314Test-1007515436 None] Group tempest-GroupsV314Test-Group-1840891786: creating
Apr 15 16:27:02 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b70adfb4-3074-45a1-9993-070e7913fa4f tempest-GroupsV314Test-1007515436 None] Group tempest-GroupsV314Test-Group-1840891786: created successfully
Apr 15 16:27:02 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b70adfb4-3074-45a1-9993-070e7913fa4f tempest-GroupsV314Test-1007515436 None] Create group completed successfully.
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Flow 'volume_create_manager' (2008217d-9d3e-405b-b789-81c761b5104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ce42cd-f1c7-4576-85c4-d19a52a4915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ce42cd-f1c7-4576-85c4-d19a52a4915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763343693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d7677d2a-6544-4f55-99de-632875e91e96,host='devstack@QuobyteHD#QuobyteHD',id=21d2726c-5e5e-43e8-aece-ac78aed56814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba5745a2cd64f57a4685a69fac9b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:04Z,use_quota=True,user_id='68c9c78081db4bf8a5dce4f93fd62092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b456a955-0b21-4415-a0f2-5314a9a4654d),volume_type_id=b456a955-0b21-4415-a0f2-5314a9a4654d)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0933ed-3553-428d-9141-6721a0a5d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0933ed-3553-428d-9141-6721a0a5d581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf5a9db-6964-4cf0-9f83-a305434cbd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf5a9db-6964-4cf0-9f83-a305434cbd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d2726c-5e5e-43e8-aece-ac78aed56814', 'volume_name': 'volume-21d2726c-5e5e-43e8-aece-ac78aed56814', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cefb150-90db-4537-aeee-43a30c4c2bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cefb150-90db-4537-aeee-43a30c4c2bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9d40db-1f62-43a6-b9d8-36cefe340824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:04 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Volume 21d2726c-5e5e-43e8-aece-ac78aed56814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d2726c-5e5e-43e8-aece-ac78aed56814', 'volume_size': 1}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d7677d2a-6544-4f55-99de-632875e91e96,created_at=2026-04-15T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763343693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d7677d2a-6544-4f55-99de-632875e91e96,host='devstack@QuobyteHD#QuobyteHD',id=21d2726c-5e5e-43e8-aece-ac78aed56814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba5745a2cd64f57a4685a69fac9b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:04Z,use_quota=True,user_id='68c9c78081db4bf8a5dce4f93fd62092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b456a955-0b21-4415-a0f2-5314a9a4654d),volume_type_id=b456a955-0b21-4415-a0f2-5314a9a4654d)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Creating volume 21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:27:04 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:27:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:04 devstack sudo[82728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 1073741824
Apr 15 16:27:04 devstack sudo[82728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:05 devstack sudo[82728]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 1073741824" returned: 0 in 0.691s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:05 devstack sudo[83046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814
Apr 15 16:27:05 devstack sudo[83046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:05 devstack sudo[83046]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814" returned: 0 in 0.490s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:27:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9d40db-1f62-43a6-b9d8-36cefe340824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d2726c-5e5e-43e8-aece-ac78aed56814', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a18a1c-0b2a-46cd-8a5c-105abf83a5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Volume volume-21d2726c-5e5e-43e8-aece-ac78aed56814 (21d2726c-5e5e-43e8-aece-ac78aed56814): created successfully
Apr 15 16:27:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a18a1c-0b2a-46cd-8a5c-105abf83a5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Flow 'volume_create_manager' (2008217d-9d3e-405b-b789-81c761b5104d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:05 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-96002a55-8c44-41cb-b59e-bfdc3d953410 tempest-GroupsV314Test-1007515436 None] Created volume successfully.
Apr 15 16:27:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:07 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Cloning volume 21d2726c-5e5e-43e8-aece-ac78aed56814 to volume 2ea96883-4cd6-48b2-bb15-d2af1cc72684
Apr 15 16:27:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Creating offline snapshot 8d2287fa-4c51-4193-b7bd-529f52c66344 of volume 21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:27:07 devstack cinder-volume[82156]: INFO oslo.privsep.daemon [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnm0_l59g/privsep.sock']
Apr 15 16:27:07 devstack sudo[83055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnm0_l59g/privsep.sock
Apr 15 16:27:07 devstack sudo[83055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:08 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 15 16:27:08 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 16:27:08 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 16:27:08 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 16:27:08 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 16:27:08 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 16:27:08 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 16:27:08 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 16:27:08 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 15 16:27:09 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 15 16:27:09 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 16:27:09 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 16:27:09 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 16:27:09 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 16:27:09 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 16:27:09 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 16:27:09 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 16:27:09 devstack cinder-volume[82156]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 15 16:27:10 devstack sudo[83055]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:10 devstack cinder-volume[82156]: INFO oslo.privsep.daemon [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Spawned new privsep daemon via rootwrap
Apr 15 16:27:10 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Accepted privsep connection to /tmp/tmpnm0_l59g/privsep.sock {{(pid=82156) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 15 16:27:10 devstack cinder-volume[82156]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 15 16:27:10 devstack cinder-volume[82156]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 15 16:27:10 devstack cinder-volume[82156]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 15 16:27:10 devstack cinder-volume[82156]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83065
Apr 15 16:27:10 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1134f43-042e-40b1-8190-7e10d0d95ffd]: (2,) {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:10 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8ba7d2-9901-4a54-aa90-ba8b84104cf7]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:11 devstack sudo[83070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814
Apr 15 16:27:11 devstack sudo[83070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:12 devstack sudo[83070]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814" returned: 0 in 1.384s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:12 devstack sudo[83079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 1G
Apr 15 16:27:12 devstack sudo[83079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:13 devstack sudo[83079]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 1G" returned: 0 in 0.839s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d2726c-5e5e-43e8-aece-ac78aed56814 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:13 devstack sudo[83086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d2726c-5e5e-43e8-aece-ac78aed56814 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344
Apr 15 16:27:13 devstack sudo[83086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:13 devstack sudo[83086]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d2726c-5e5e-43e8-aece-ac78aed56814 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344" returned: 0 in 0.756s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:13 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:27:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:14 devstack sudo[83095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344
Apr 15 16:27:14 devstack sudo[83095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Flow 'volume_create_manager' (55e481df-d76c-44f5-a83c-1c11b8a2f01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b647b67-8df6-4bef-9319-944897cecc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b647b67-8df6-4bef-9319-944897cecc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2056345321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49922f0-e5b9-4620-89b6-899b2dc244a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ad8375f35c4d17b80fcfe46257e0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:14Z,use_quota=True,user_id='2a3a4f0a2c3f4548a804b96955517942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe034d4-2679-4273-b72b-2a3915d7abeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe034d4-2679-4273-b72b-2a3915d7abeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1034b6-ed7c-42f5-b1e9-8078ed62823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1034b6-ed7c-42f5-b1e9-8078ed62823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49922f0-e5b9-4620-89b6-899b2dc244a6', 'volume_name': 'volume-f49922f0-e5b9-4620-89b6-899b2dc244a6', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c1276a-ee85-492f-a70d-ceeb3b066ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c1276a-ee85-492f-a70d-ceeb3b066ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2eac64-3172-4911-b3bc-6b9a9951fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:14 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Volume f49922f0-e5b9-4620-89b6-899b2dc244a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49922f0-e5b9-4620-89b6-899b2dc244a6', 'volume_size': 1}
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:14 devstack sudo[83095]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344" returned: 0 in 1.066s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:15 devstack sudo[83106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.info
Apr 15 16:27:15 devstack sudo[83106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:15 devstack sudo[83106]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.info" returned: 0 in 0.584s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:15 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:27:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:15 devstack sudo[83127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.info
Apr 15 16:27:15 devstack sudo[83127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:16 devstack sudo[83127]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.info" returned: 0 in 0.393s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Acquiring lock "cinder-quobyte-2ea96883-4cd6-48b2-bb15-d2af1cc72684" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Lock "cinder-quobyte-2ea96883-4cd6-48b2-bb15-d2af1cc72684" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] snapshot: 8d2287fa-4c51-4193-b7bd-529f52c66344, volume: 2ea96883-4cd6-48b2-bb15-d2af1cc72684,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0aa302b-3043-498f-a65e-f3b490539546]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:16 devstack sudo[83136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344
Apr 15 16:27:16 devstack sudo[83136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:16 devstack sudo[83136]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344" returned: 0 in 0.483s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21d2726c-5e5e-43e8-aece-ac78aed56814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e197f2-7cd7-44ea-99cb-d68f18a1e952]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:16 devstack sudo[83147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814
Apr 15 16:27:16 devstack sudo[83147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:17 devstack sudo[83147]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814" returned: 0 in 0.544s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:17 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:27:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:17 devstack sudo[83152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684
Apr 15 16:27:17 devstack sudo[83152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:21 devstack sudo[83152]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684" returned: 0 in 4.687s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:21 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f541bf-7603-4c36-ac73-398b2d1b273d]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:21 devstack sudo[83224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814
Apr 15 16:27:21 devstack sudo[83224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:23 devstack sudo[83224]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814" returned: 0 in 1.440s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:23 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:27:23 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Converted 1024.00 MB image at 218.43 MB/s
Apr 15 16:27:23 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:27:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:23 devstack sudo[83235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684
Apr 15 16:27:23 devstack sudo[83235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:24 devstack sudo[83235]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684" returned: 0 in 0.976s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Lock "cinder-quobyte-2ea96883-4cd6-48b2-bb15-d2af1cc72684" released by "_copy_volume_from_snapshot" :: held 8.211s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Acquiring lock "cinder-quobyte-8d2287fa-4c51-4193-b7bd-529f52c66344" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Lock "cinder-quobyte-8d2287fa-4c51-4193-b7bd-529f52c66344" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Deleting offline snapshot 8d2287fa-4c51-4193-b7bd-529f52c66344 of volume 21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] snapshot_file for this snap is: volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92dd13c-5d15-4b81-9ab7-3246de0c2d1a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:24 devstack sudo[83240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344
Apr 15 16:27:24 devstack sudo[83240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Flow 'volume_create_manager' (0820d5be-8a83-4468-b7d3-053bea5eddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5b9031-502c-4de3-83c8-eedb044cb020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5b9031-502c-4de3-83c8-eedb044cb020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-575813031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5691f600-538a-42d8-bf3d-c58aa6838bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5921e2a2f8844b0fa4cb24a7d6988fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:25Z,use_quota=True,user_id='c534960695764c1885e74807a526cb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cc657f-ab96-468e-a877-a93913da9f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cc657f-ab96-468e-a877-a93913da9f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be2a323-fc5f-4a3c-84ac-20c4959c622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be2a323-fc5f-4a3c-84ac-20c4959c622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5691f600-538a-42d8-bf3d-c58aa6838bf1', 'volume_name': 'volume-5691f600-538a-42d8-bf3d-c58aa6838bf1', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c850b6fc-c01d-4e86-96d8-8e34208aa401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c850b6fc-c01d-4e86-96d8-8e34208aa401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ead091d-1bb6-4f24-9272-360ff2ab64d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:24 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Volume 5691f600-538a-42d8-bf3d-c58aa6838bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5691f600-538a-42d8-bf3d-c58aa6838bf1', 'volume_size': 1}
Apr 15 16:27:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:25 devstack sudo[83240]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344" returned: 0 in 1.003s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21d2726c-5e5e-43e8-aece-ac78aed56814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:27:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca814f2-2b91-4014-84b7-1836074c7da6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:25 devstack sudo[83246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814
Apr 15 16:27:25 devstack sudo[83246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:26 devstack sudo[83246]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814" returned: 0 in 0.731s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:26 devstack sudo[83251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344
Apr 15 16:27:26 devstack sudo[83251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:26 devstack sudo[83251]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344" returned: 0 in 0.567s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:26 devstack sudo[83259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344
Apr 15 16:27:26 devstack sudo[83259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:27 devstack sudo[83259]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814.8d2287fa-4c51-4193-b7bd-529f52c66344" returned: 0 in 0.461s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Lock "cinder-quobyte-8d2287fa-4c51-4193-b7bd-529f52c66344" released by "_delete_snapshot" :: held 2.918s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.555s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.810s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2056345321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49922f0-e5b9-4620-89b6-899b2dc244a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ad8375f35c4d17b80fcfe46257e0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:14Z,use_quota=True,user_id='2a3a4f0a2c3f4548a804b96955517942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Creating volume f49922f0-e5b9-4620-89b6-899b2dc244a6 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:27:27 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:27 devstack sudo[83262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6 1073741824
Apr 15 16:27:27 devstack sudo[83262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:27 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8c3b8ea5-26cb-49d1-a0cb-0ce2dc8e37c6 tempest-GroupsV314Test-1007515436 None] Create group from source-group-d7677d2a-6544-4f55-99de-632875e91e96 completed successfully.
Apr 15 16:27:27 devstack sudo[83262]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6 1073741824" returned: 0 in 0.623s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:27 devstack sudo[83268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6
Apr 15 16:27:27 devstack sudo[83268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:28 devstack sudo[83268]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6" returned: 0 in 0.640s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.556s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-575813031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5691f600-538a-42d8-bf3d-c58aa6838bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5921e2a2f8844b0fa4cb24a7d6988fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:25Z,use_quota=True,user_id='c534960695764c1885e74807a526cb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Creating volume 5691f600-538a-42d8-bf3d-c58aa6838bf1 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:27:28 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2eac64-3172-4911-b3bc-6b9a9951fda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49922f0-e5b9-4620-89b6-899b2dc244a6', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e8205c-4f20-4b2c-94ed-0fc8659c9028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:28 devstack sudo[83297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1 1073741824
Apr 15 16:27:28 devstack sudo[83297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:28 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Volume volume-f49922f0-e5b9-4620-89b6-899b2dc244a6 (f49922f0-e5b9-4620-89b6-899b2dc244a6): created successfully
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e8205c-4f20-4b2c-94ed-0fc8659c9028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:28 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Flow 'volume_create_manager' (55e481df-d76c-44f5-a83c-1c11b8a2f01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:28 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-16096254-abf5-4438-ab0e-f4b1098bc97c tempest-VolumesAdminNegativeTest-792139589 None] Created volume successfully.
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Acquiring lock "cinder-quobyte-2ea96883-4cd6-48b2-bb15-d2af1cc72684" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Lock "cinder-quobyte-2ea96883-4cd6-48b2-bb15-d2af1cc72684" acquired by "delete_volume" :: waited 0.027s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e03e9-b49f-4603-af57-1b708d6cba18]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:29 devstack sudo[83307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684
Apr 15 16:27:29 devstack sudo[83307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Acquiring lock "cinder-f49922f0-e5b9-4620-89b6-899b2dc244a6-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Lock "cinder-f49922f0-e5b9-4620-89b6-899b2dc244a6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Acquiring lock "cinder-quobyte-f49922f0-e5b9-4620-89b6-899b2dc244a6" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Lock "cinder-quobyte-f49922f0-e5b9-4620-89b6-899b2dc244a6" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c1623d-9339-4a0b-a1e8-380b893107f3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:29 devstack sudo[83312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6
Apr 15 16:27:29 devstack sudo[83312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:29 devstack sudo[83297]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1 1073741824" returned: 0 in 1.372s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:29 devstack sudo[83307]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684" returned: 0 in 0.782s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:29 devstack sudo[83318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684
Apr 15 16:27:29 devstack sudo[83318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:29 devstack sudo[83319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1
Apr 15 16:27:29 devstack sudo[83319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:30 devstack sudo[83318]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2ea96883-4cd6-48b2-bb15-d2af1cc72684" returned: 0 in 0.710s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Lock "cinder-quobyte-2ea96883-4cd6-48b2-bb15-d2af1cc72684" released by "delete_volume" :: held 1.592s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:27:30 devstack sudo[83312]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:30 devstack sudo[83319]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1" returned: 0 in 0.863s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6" returned: 0 in 1.217s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] <== create_volume: return (2291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:30 devstack sudo[83329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6
Apr 15 16:27:30 devstack sudo[83329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ead091d-1bb6-4f24-9272-360ff2ab64d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5691f600-538a-42d8-bf3d-c58aa6838bf1', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5f40ea-dfd7-4837-9b94-876d21b921ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Volume volume-5691f600-538a-42d8-bf3d-c58aa6838bf1 (5691f600-538a-42d8-bf3d-c58aa6838bf1): created successfully
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5f40ea-dfd7-4837-9b94-876d21b921ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Flow 'volume_create_manager' (0820d5be-8a83-4468-b7d3-053bea5eddc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:30 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Created reservations ['ac37cc54-1465-4833-b448-a25c565b3eb7'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:27:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-89e492f6-ed98-4b2e-8d18-24d6fc47e951 tempest-ServerRescueNegativeTestJSON-877209311 None] Created volume successfully.
Apr 15 16:27:31 devstack cinder-volume[82156]: WARNING cinder.quota [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1409728601 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1409728601, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:27:31 devstack cinder-volume[82156]: WARNING cinder.quota [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1409728601 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1409728601, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Created reservations ['e81864fc-2152-4313-8275-e44e9494667d', '48f96d22-33ee-4781-a1ac-687c88895f4a', '76779cba-9e88-42c2-b828-6b41c1e4ccdb', '2727d0a5-e17c-402a-a13f-a31292aa5a52'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:31 devstack sudo[83331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:27:31 devstack sudo[83331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:31 devstack sudo[83329]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f49922f0-e5b9-4620-89b6-899b2dc244a6" returned: 0 in 0.853s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Lock "cinder-quobyte-f49922f0-e5b9-4620-89b6-899b2dc244a6" released by "delete_volume" :: held 2.158s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:27:31 devstack cinder-volume[82156]: WARNING cinder.quota [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:27:31 devstack cinder-volume[82156]: WARNING cinder.quota [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:27:31 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Created reservations ['9c0ccfeb-369b-4d8c-8ad6-9eae6214f74a', '934459b7-35a9-4010-84d2-82f23d2c43c5', '1b41bee4-3e91-435e-b50f-ff50a2ee253f', 'dae932cd-5e97-47fe-926f-448446062b97'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Acquiring lock "cinder-quobyte-21d2726c-5e5e-43e8-aece-ac78aed56814" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Lock "cinder-quobyte-21d2726c-5e5e-43e8-aece-ac78aed56814" acquired by "delete_volume" :: waited 0.022s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ce1bfd-ea19-4b29-a8a0-dcef60415fd8]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:32 devstack sudo[83348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:27:32 devstack sudo[83348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:32 devstack sudo[83351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814
Apr 15 16:27:32 devstack sudo[83351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:32 devstack sudo[83331]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 1.293s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:32 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:27:32 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-19a81e21-87da-4d02-a7c1-945a85f398dc tempest-GroupsV314Test-1007515436 None] Delete group completed successfully.
Apr 15 16:27:33 devstack sudo[83348]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 1.223s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:33 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:27:33 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Deleted volume successfully.
Apr 15 16:27:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-471d9ff4-bce8-4067-85cc-2175019dcccb tempest-VolumesAdminNegativeTest-792139589 None] Lock "cinder-f49922f0-e5b9-4620-89b6-899b2dc244a6-delete_volume" released by "delete_volume" :: held 3.937s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:27:33 devstack sudo[83351]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814" returned: 0 in 1.333s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:33 devstack sudo[83379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814
Apr 15 16:27:33 devstack sudo[83379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:34 devstack sudo[83379]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-21d2726c-5e5e-43e8-aece-ac78aed56814" returned: 0 in 0.807s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Lock "cinder-quobyte-21d2726c-5e5e-43e8-aece-ac78aed56814" released by "delete_volume" :: held 2.316s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Created reservations ['9b69c9fb-32d6-464e-987d-996cc3caef04'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Created reservations ['84add43f-c3b2-44a4-9701-9038d9df4e87', 'e8dac112-2539-4e51-8191-21e8e83886a3', '89d54c63-d4b5-4b00-afb9-e73e12d4df13', '351414d3-6ea7-4e6e-a23a-199813d679b5'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:34 devstack sudo[83406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:27:34 devstack sudo[83406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:35 devstack sudo[83406]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.778s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:35 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:27:35 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5ddbd325-1587-4ae1-a8cf-10245c211e96 tempest-GroupsV314Test-1007515436 None] Delete group completed successfully.
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Flow 'volume_create_manager' (8b6f4a62-d9c3-4b24-abe4-f4c67a8f7802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6e19ce-9126-4fb9-af41-0eb5af8289b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6e19ce-9126-4fb9-af41-0eb5af8289b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-714288509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e925d30d05f5402597d1ebb7b080a7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:41Z,use_quota=True,user_id='f61cda5a3bd2436083e3a79b31643e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e892cd-7135-474c-86cf-dddf3e361292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e892cd-7135-474c-86cf-dddf3e361292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6767f6f-5fcf-41e0-a53d-d172fd4b59e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6767f6f-5fcf-41e0-a53d-d172fd4b59e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd', 'volume_name': 'volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b922ab3-396e-4f13-b1fe-1e26c808cf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b922ab3-396e-4f13-b1fe-1e26c808cf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8166db7-5eda-4122-a075-10fe73b80058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd', 'volume_size': 1}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-714288509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e925d30d05f5402597d1ebb7b080a7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:41Z,use_quota=True,user_id='f61cda5a3bd2436083e3a79b31643e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Creating volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:27:40 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:27:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:40 devstack sudo[83502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd 1073741824
Apr 15 16:27:40 devstack sudo[83502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:42 devstack sudo[83502]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd 1073741824" returned: 0 in 1.516s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:42 devstack sudo[83513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd
Apr 15 16:27:42 devstack sudo[83513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:43 devstack sudo[83513]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" returned: 0 in 0.889s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:27:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8166db7-5eda-4122-a075-10fe73b80058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b364b3-d763-4942-95e1-5fd1495440cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:43 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Volume volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd (5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd): created successfully
Apr 15 16:27:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b364b3-d763-4942-95e1-5fd1495440cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Flow 'volume_create_manager' (8b6f4a62-d9c3-4b24-abe4-f4c67a8f7802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:43 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cd43717f-7206-4d2f-919b-f3221370859d tempest-SnapshotsActionsTest-173340170 None] Created volume successfully.
Apr 15 16:27:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Creating offline snapshot 998438b3-0664-4aa8-be7f-06f30b5b72f1 of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:27:44 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[153bc6a8-833e-400e-9a14-a42006fecdbd]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:44 devstack sudo[83520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd
Apr 15 16:27:44 devstack sudo[83520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:45 devstack sudo[83520]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" returned: 0 in 1.010s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:45 devstack sudo[83530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 1G
Apr 15 16:27:45 devstack sudo[83530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:46 devstack sudo[83530]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 1G" returned: 0 in 1.546s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:46 devstack sudo[83542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:27:46 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:48 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 1.324s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:48 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 is being set with open permissions: ugo+rw
Apr 15 16:27:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:48 devstack sudo[83594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:27:48 devstack sudo[83594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:49 devstack sudo[83594]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.984s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:49 devstack sudo[83601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.info
Apr 15 16:27:49 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:27:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:49 devstack sudo[83605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:27:49 devstack sudo[83605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:50 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.info" returned: 0 in 1.439s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:50 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.info is being set with open permissions: ugo+rw
Apr 15 16:27:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:50 devstack sudo[83609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.info
Apr 15 16:27:50 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:50 devstack sudo[83605]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 1.159s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Flow 'volume_create_manager' (c9eab68c-a294-41a7-a5c7-ecbb0ac80560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa509ec1-9c2d-447b-9b54-e9976395afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Acquiring lock "cinder-5691f600-538a-42d8-bf3d-c58aa6838bf1-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa509ec1-9c2d-447b-9b54-e9976395afbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:27:51Z,deleted=False,deleted_at=None,display_description='',display_name='221f66a6-ce2f-4868-b067-bb4877b2e1c5-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6fad04-677f-406c-9254-8fb6effd11ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54446f9f53c741f2baecd3b4e368eade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:51Z,use_quota=True,user_id='aff43bb17a0a4a978bb30f06bb6320c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8d64a4-e4c1-4541-82ec-06bb4fbd2b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8d64a4-e4c1-4541-82ec-06bb4fbd2b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:51 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340c62df-4646-4dd4-9712-164d85f7ca92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340c62df-4646-4dd4-9712-164d85f7ca92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6fad04-677f-406c-9254-8fb6effd11ab', 'volume_name': 'volume-6c6fad04-677f-406c-9254-8fb6effd11ab', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffd0499-b220-4b2b-9243-230e5dc12b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffd0499-b220-4b2b-9243-230e5dc12b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4a045d-e58e-4728-a2bc-fdf18297b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:51 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Volume 6c6fad04-677f-406c-9254-8fb6effd11ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6fad04-677f-406c-9254-8fb6effd11ab', 'volume_size': 1}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "cinder-5691f600-538a-42d8-bf3d-c58aa6838bf1-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.info" returned: 0 in 1.022s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.560s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.088s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:27:51Z,deleted=False,deleted_at=None,display_description='',display_name='221f66a6-ce2f-4868-b067-bb4877b2e1c5-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6fad04-677f-406c-9254-8fb6effd11ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54446f9f53c741f2baecd3b4e368eade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:27:51Z,use_quota=True,user_id='aff43bb17a0a4a978bb30f06bb6320c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Creating volume 6c6fad04-677f-406c-9254-8fb6effd11ab {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:27:51 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:27:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:51 devstack sudo[83614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab 1073741824
Apr 15 16:27:51 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-bd5bd593-3a65-402b-be46-e71f8d625040 tempest-SnapshotsActionsTest-173340170 None] Create snapshot completed successfully
Apr 15 16:27:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Acquiring lock "cinder-quobyte-5691f600-538a-42d8-bf3d-c58aa6838bf1" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "cinder-quobyte-5691f600-538a-42d8-bf3d-c58aa6838bf1" acquired by "delete_volume" :: waited 0.016s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[673dc209-0edf-4055-988c-6f499caf72ee]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:52 devstack sudo[83616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1
Apr 15 16:27:52 devstack sudo[83616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:53 devstack sudo[83616]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1" returned: 0 in 1.252s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:53 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab 1073741824" returned: 0 in 1.549s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:53 devstack sudo[83626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1
Apr 15 16:27:53 devstack sudo[83626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:53 devstack sudo[83628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab
Apr 15 16:27:53 devstack sudo[83628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:54 devstack sudo[83626]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5691f600-538a-42d8-bf3d-c58aa6838bf1" returned: 0 in 0.746s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "cinder-quobyte-5691f600-538a-42d8-bf3d-c58aa6838bf1" released by "delete_volume" :: held 2.162s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Created reservations ['a3ce88b8-9407-4b13-98a7-df06a4ec55f4', '62c20617-25e0-4737-b69c-fd0dab07d467', 'e20d6ea0-0181-4ddc-8fef-49d4c5fd2f0f', '83936a8e-0fa8-4f63-a787-56318e0fd4ec'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:54 devstack sudo[83636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:27:54 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:54 devstack sudo[83628]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab" returned: 0 in 0.990s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] <== create_volume: return (2634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.650s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.879s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Creating offline snapshot 0398d651-76c8-4112-9293-227671e5eb7b of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4a045d-e58e-4728-a2bc-fdf18297b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6fad04-677f-406c-9254-8fb6effd11ab', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b67245-3c3f-4d0e-81e4-debe0634ee50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:27:54 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Volume volume-6c6fad04-677f-406c-9254-8fb6effd11ab (6c6fad04-677f-406c-9254-8fb6effd11ab): created successfully
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b67245-3c3f-4d0e-81e4-debe0634ee50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Flow 'volume_create_manager' (c9eab68c-a294-41a7-a5c7-ecbb0ac80560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[660b4f0e-48b7-4c50-a044-e6a0850c8fbb]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:54 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-24a04783-25a3-483d-a2f5-f8c06895cd62 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Created volume successfully.
Apr 15 16:27:54 devstack sudo[83650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:27:54 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:55 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.997s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:55 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:27:55 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Deleted volume successfully.
Apr 15 16:27:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-eb2e388f-0e25-4b59-b3af-26a45e3b2ce2 tempest-ServerRescueNegativeTestJSON-877209311 None] Lock "cinder-5691f600-538a-42d8-bf3d-c58aa6838bf1-delete_volume" released by "delete_volume" :: held 3.599s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:27:55 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 1.049s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:55 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:27:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:55 devstack sudo[83665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b 1G
Apr 15 16:27:55 devstack sudo[83665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:56 devstack sudo[83665]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b 1G" returned: 0 in 1.151s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:56 devstack sudo[83706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b
Apr 15 16:27:56 devstack sudo[83706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:57 devstack sudo[83706]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b" returned: 0 in 0.946s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:57 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b is being set with open permissions: ugo+rw
Apr 15 16:27:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:57 devstack sudo[83715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b
Apr 15 16:27:57 devstack sudo[83715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:27:58 devstack sudo[83715]: pam_unix(sudo:session): session closed for user root
Apr 15 16:27:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b" returned: 0 in 0.521s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:27:58 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=61,cinder:UPDATE=73,cinder:INSERT=13,cinder:DELETE=2 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:27:58 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=44,cinder:UPDATE=45,cinder:DELETE=6,cinder:INSERT=13 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:27:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.984s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:27:58 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cf2a7796-e26c-4354-8c42-5c19685a2264 tempest-SnapshotsActionsTest-173340170 None] Create snapshot completed successfully
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-0398d651-76c8-4112-9293-227671e5eb7b-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-0398d651-76c8-4112-9293-227671e5eb7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-quobyte-0398d651-76c8-4112-9293-227671e5eb7b" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-0398d651-76c8-4112-9293-227671e5eb7b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Deleting offline snapshot 0398d651-76c8-4112-9293-227671e5eb7b of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] snapshot_file for this snap is: volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92fdf95-fe96-47d2-bd70-5ba031d76f16]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:27:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:27:59 devstack sudo[83725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b
Apr 15 16:27:59 devstack sudo[83725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:00 devstack sudo[83725]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b" returned: 0 in 0.945s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:00 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8484b7f0-c3d7-48c0-a4b1-8b471e8a3003]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:00 devstack sudo[83733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:00 devstack sudo[83733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:00 devstack cinder-volume[82156]: WARNING py.warnings [req-c1e267ed-5682-421e-9148-e32312617981 req-4cc735ba-f868-474c-a982-7f140e243259 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 15 16:28:00 devstack cinder-volume[82156]:   .first()
Apr 15 16:28:00 devstack cinder-volume[82156]: 
Apr 15 16:28:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c1e267ed-5682-421e-9148-e32312617981 req-4cc735ba-f868-474c-a982-7f140e243259 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c1e267ed-5682-421e-9148-e32312617981 req-4cc735ba-f868-474c-a982-7f140e243259 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:00 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a3fd7-7c63-4634-aa98-3d58bc91a76d]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c1e267ed-5682-421e-9148-e32312617981 req-4cc735ba-f868-474c-a982-7f140e243259 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:00 devstack sudo[83749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab
Apr 15 16:28:00 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:01 devstack sudo[83733]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.916s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:01 devstack sudo[83769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b
Apr 15 16:28:01 devstack sudo[83769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:01 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c1e267ed-5682-421e-9148-e32312617981 req-4cc735ba-f868-474c-a982-7f140e243259 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab" returned: 0 in 1.078s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c1e267ed-5682-421e-9148-e32312617981 req-4cc735ba-f868-474c-a982-7f140e243259 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.104s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-4cc735ba-f868-474c-a982-7f140e243259 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6', 'name': 'volume-6c6fad04-677f-406c-9254-8fb6effd11ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9473589d-f41b-444b-b095-94877ba2a7ef', 'enforce_multipath': True} {{(pid=82156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 16:28:02 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-c1e267ed-5682-421e-9148-e32312617981 req-4cc735ba-f868-474c-a982-7f140e243259 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] attachment_update completed successfully.
Apr 15 16:28:02 devstack sudo[83769]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b" returned: 0 in 1.366s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:02 devstack sudo[83778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b
Apr 15 16:28:02 devstack sudo[83778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:03 devstack sudo[83778]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.0398d651-76c8-4112-9293-227671e5eb7b" returned: 0 in 0.661s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:03 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-0398d651-76c8-4112-9293-227671e5eb7b" released by "_delete_snapshot" :: held 4.120s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:03 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" released by "delete_snapshot" :: held 4.144s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:03 devstack cinder-volume[82156]: WARNING cinder.quota [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:28:03 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Created reservations ['1cce5b4e-a103-4a87-9cee-5ad6fcfba35f', '67d080ce-53c3-46f1-b080-b79576be3b15', '308011fb-f9a5-4596-b3e5-ee6c8407d451', '357b90fe-15fa-4552-a031-1e14c4cffb9d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:03 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Delete snapshot completed successfully.
Apr 15 16:28:03 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6f2dfc02-edc1-4412-b0cc-aefdd8dae02b tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-0398d651-76c8-4112-9293-227671e5eb7b-delete_snapshot" released by "delete_snapshot" :: held 4.347s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Creating offline snapshot ffe3bf9d-5fc7-4aad-aa76-04e081350dab of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:28:04 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb2bba7-daeb-4819-92df-cc64d76d61b3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:04 devstack sudo[83876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:04 devstack sudo[83876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:05 devstack sudo[83876]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.645s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:05 devstack sudo[83886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab 1G
Apr 15 16:28:05 devstack sudo[83886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:05 devstack sudo[83886]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab 1G" returned: 0 in 0.613s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:05 devstack sudo[83896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab
Apr 15 16:28:05 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:06 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab" returned: 0 in 0.653s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:06 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab is being set with open permissions: ugo+rw
Apr 15 16:28:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:06 devstack sudo[83904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab
Apr 15 16:28:06 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:07 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab" returned: 0 in 0.533s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.512s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:07 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-93af1afd-aabb-41e6-be41-650dbed1d890 tempest-SnapshotsActionsTest-173340170 None] Create snapshot completed successfully
Apr 15 16:28:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-ffe3bf9d-5fc7-4aad-aa76-04e081350dab-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-ffe3bf9d-5fc7-4aad-aa76-04e081350dab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-quobyte-ffe3bf9d-5fc7-4aad-aa76-04e081350dab" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-ffe3bf9d-5fc7-4aad-aa76-04e081350dab" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Deleting offline snapshot ffe3bf9d-5fc7-4aad-aa76-04e081350dab of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:28:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] snapshot_file for this snap is: volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:28:08 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e09927-159e-475f-b471-a73421c0774c]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:08 devstack sudo[84243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab
Apr 15 16:28:08 devstack sudo[84243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:08 devstack sudo[84243]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab" returned: 0 in 0.695s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:08 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a711b887-b931-4df4-955a-1bb74ced7a91]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:08 devstack sudo[84248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:08 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:09 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.662s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:09 devstack sudo[84254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab
Apr 15 16:28:09 devstack sudo[84254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:10 devstack sudo[84254]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab" returned: 0 in 0.788s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:10 devstack sudo[84261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab
Apr 15 16:28:10 devstack sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:10 devstack sudo[84261]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.ffe3bf9d-5fc7-4aad-aa76-04e081350dab" returned: 0 in 0.623s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-ffe3bf9d-5fc7-4aad-aa76-04e081350dab" released by "_delete_snapshot" :: held 2.881s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" released by "delete_snapshot" :: held 2.900s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:10 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Created reservations ['84cca163-49b4-49b8-bd60-f6c2c20a211b', 'f477bfcf-ef2f-48e4-8b5c-6a8343f4679f', '9feda039-717a-4b3c-b26a-c26a439a6d05', 'ecd35301-0bb1-4fd5-8050-0abc75869a89'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:11 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Delete snapshot completed successfully.
Apr 15 16:28:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb7d71ea-0967-49b4-aee0-fd8baaa5a927 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-ffe3bf9d-5fc7-4aad-aa76-04e081350dab-delete_snapshot" released by "delete_snapshot" :: held 3.041s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Creating offline snapshot bec11d2f-7edb-49a4-9509-513b434cd0b4 of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:28:11 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2821c9-3196-4829-a27b-fd52485cca14]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:11 devstack sudo[84268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:11 devstack sudo[84268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:12 devstack sudo[84268]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.653s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:12 devstack sudo[84273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 1G
Apr 15 16:28:12 devstack sudo[84273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:13 devstack sudo[84273]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 1G" returned: 0 in 0.624s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:13 devstack sudo[84278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4
Apr 15 16:28:13 devstack sudo[84278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:13 devstack sudo[84278]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4" returned: 0 in 0.504s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:13 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 is being set with open permissions: ugo+rw
Apr 15 16:28:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:13 devstack sudo[84288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4
Apr 15 16:28:13 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:14 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4" returned: 0 in 0.522s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:14 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9bbb2cd7-1367-4cd0-bdc3-a9c8f249c7d8 tempest-SnapshotsActionsTest-173340170 None] Create snapshot completed successfully
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-bec11d2f-7edb-49a4-9509-513b434cd0b4-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-bec11d2f-7edb-49a4-9509-513b434cd0b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-quobyte-bec11d2f-7edb-49a4-9509-513b434cd0b4" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-bec11d2f-7edb-49a4-9509-513b434cd0b4" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Deleting offline snapshot bec11d2f-7edb-49a4-9509-513b434cd0b4 of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] snapshot_file for this snap is: volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[af268670-f8cb-488e-9d95-566dadd7e461]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:14 devstack sudo[84297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4
Apr 15 16:28:14 devstack sudo[84297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:15 devstack sudo[84297]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4" returned: 0 in 0.525s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:15 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[07014de0-561e-4a3c-b79c-1b075d7174ab]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:15 devstack sudo[84302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:15 devstack sudo[84302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:15 devstack sudo[84302]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.563s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:15 devstack sudo[84307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4
Apr 15 16:28:15 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:16 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4" returned: 0 in 0.485s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:16 devstack sudo[84312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4
Apr 15 16:28:16 devstack sudo[84312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Flow 'volume_create_manager' (c202bc6e-9e23-422d-bc98-d8b84ac786dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d28e51-9d3f-484e-bf7d-a28c23ad3732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d28e51-9d3f-484e-bf7d-a28c23ad3732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-938638173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898455f9-33d8-45de-be7d-4d3ab7c78d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af3d59b0eb420283fcac52f7f14971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:17Z,use_quota=True,user_id='18acd3922ecc438d9790ddfd7de983dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655a08ce-35cc-4063-8152-d06eeb64cec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655a08ce-35cc-4063-8152-d06eeb64cec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7d3639-80d2-4713-ad6a-56a6c828ba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7d3639-80d2-4713-ad6a-56a6c828ba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898455f9-33d8-45de-be7d-4d3ab7c78d16', 'volume_name': 'volume-898455f9-33d8-45de-be7d-4d3ab7c78d16', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a808bca0-7e3e-48c4-91fb-72b39a8f6604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a808bca0-7e3e-48c4-91fb-72b39a8f6604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e76c83-4d1d-412c-852f-f18e43d0adc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:16 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Volume 898455f9-33d8-45de-be7d-4d3ab7c78d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898455f9-33d8-45de-be7d-4d3ab7c78d16', 'volume_size': 1}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-938638173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898455f9-33d8-45de-be7d-4d3ab7c78d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af3d59b0eb420283fcac52f7f14971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:17Z,use_quota=True,user_id='18acd3922ecc438d9790ddfd7de983dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Creating volume 898455f9-33d8-45de-be7d-4d3ab7c78d16 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:28:16 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:16 devstack sudo[84314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 1073741824
Apr 15 16:28:16 devstack sudo[84314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:16 devstack sudo[84312]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.bec11d2f-7edb-49a4-9509-513b434cd0b4" returned: 0 in 0.458s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-bec11d2f-7edb-49a4-9509-513b434cd0b4" released by "_delete_snapshot" :: held 2.086s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" released by "delete_snapshot" :: held 2.101s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Created reservations ['7c1521b5-0394-4ae2-b00e-f46d7c48d8cb', 'bc66f1b8-00b0-4835-a729-dada1996e1d5', '5894c137-d070-44b0-8132-fabc8cc9eac7', 'd365256a-64e5-4965-8570-ea312e1b3440'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:16 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Delete snapshot completed successfully.
Apr 15 16:28:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c153f531-f3ba-4a98-99fc-845245d6e4a7 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-bec11d2f-7edb-49a4-9509-513b434cd0b4-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:17 devstack sudo[84314]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 1073741824" returned: 0 in 0.518s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:17 devstack sudo[84320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16
Apr 15 16:28:17 devstack sudo[84320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:17 devstack sudo[84320]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16" returned: 0 in 0.481s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:28:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e76c83-4d1d-412c-852f-f18e43d0adc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898455f9-33d8-45de-be7d-4d3ab7c78d16', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9a12b6-80e1-4610-9402-7a361a38f151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:17 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Volume volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 (898455f9-33d8-45de-be7d-4d3ab7c78d16): created successfully
Apr 15 16:28:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9a12b6-80e1-4610-9402-7a361a38f151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Flow 'volume_create_manager' (c202bc6e-9e23-422d-bc98-d8b84ac786dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:17 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-bf9d1c28-38e9-4ac7-bbfc-4c94df7df142 req-7f810eeb-fe38-43f5-a430-96ef88903a12 tempest-VolumesSnapshotsTestJSON-1335601633 None] Created volume successfully.
Apr 15 16:28:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Creating offline snapshot 839a9632-0870-469f-8cb0-93b9718818e2 of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:28:18 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b3ebb5-19dd-4959-8bb0-e9cd4f11517e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:18 devstack sudo[84346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:18 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:18 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.646s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:18 devstack sudo[84353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 1G
Apr 15 16:28:18 devstack sudo[84353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:19 devstack sudo[84353]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 1G" returned: 0 in 0.800s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:19 devstack sudo[84363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2
Apr 15 16:28:19 devstack sudo[84363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:20 devstack sudo[84363]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:20 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 is being set with open permissions: ugo+rw
Apr 15 16:28:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:20 devstack sudo[84399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2
Apr 15 16:28:20 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:20 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2" returned: 0 in 0.442s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.590s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Creating offline snapshot 0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc of volume 898455f9-33d8-45de-be7d-4d3ab7c78d16 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:28:20 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1342fc92-2122-4bfe-946e-a3f7667c77fe tempest-SnapshotsActionsTest-173340170 None] Create snapshot completed successfully
Apr 15 16:28:20 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e310429-13a2-46f5-8b58-a4dbcc016bcc]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:20 devstack sudo[84402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16
Apr 15 16:28:20 devstack sudo[84402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:21 devstack sudo[84402]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16" returned: 0 in 0.490s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:21 devstack sudo[84407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc 1G
Apr 15 16:28:21 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-839a9632-0870-469f-8cb0-93b9718818e2-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-839a9632-0870-469f-8cb0-93b9718818e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Acquiring lock "cinder-quobyte-839a9632-0870-469f-8cb0-93b9718818e2" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-839a9632-0870-469f-8cb0-93b9718818e2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Deleting offline snapshot 839a9632-0870-469f-8cb0-93b9718818e2 of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] snapshot_file for this snap is: volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72bbdd7-4257-4d47-8d61-cbb5cb21d820]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:21 devstack sudo[84412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2
Apr 15 16:28:21 devstack sudo[84412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:21 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc 1G" returned: 0 in 0.546s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:21 devstack sudo[84414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc
Apr 15 16:28:21 devstack sudo[84414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:22 devstack sudo[84412]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2" returned: 0 in 0.532s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1e6eb4-8ab9-4df3-9ba1-7f793d3bfe2a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:22 devstack sudo[84414]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc" returned: 0 in 0.491s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:22 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc is being set with open permissions: ugo+rw
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:22 devstack sudo[84429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:22 devstack sudo[84429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:22 devstack sudo[84430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc
Apr 15 16:28:22 devstack sudo[84430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:22 devstack sudo[84430]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc" returned: 0 in 0.442s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:22 devstack sudo[84429]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.536s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:22 devstack sudo[84438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2
Apr 15 16:28:22 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:22 devstack sudo[84440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.info
Apr 15 16:28:22 devstack sudo[84440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:22 devstack sudo[84440]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.info" returned: 0 in 0.402s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:23 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.info is being set with open permissions: ugo+rw
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:23 devstack sudo[84446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.info
Apr 15 16:28:23 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:23 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2" returned: 0 in 0.471s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:23 devstack sudo[84448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2
Apr 15 16:28:23 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:23 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.info" returned: 0 in 0.448s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.969s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:23 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-c97d3b90-d64a-4774-ada5-86c4f6c922c7 req-f1ada1a5-10ce-4879-b9d3-c4a4721d2dbb tempest-VolumesSnapshotsTestJSON-1335601633 None] Create snapshot completed successfully
Apr 15 16:28:23 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.839a9632-0870-469f-8cb0-93b9718818e2" returned: 0 in 0.522s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-839a9632-0870-469f-8cb0-93b9718818e2" released by "_delete_snapshot" :: held 2.126s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" released by "delete_snapshot" :: held 2.144s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Created reservations ['d8fd8b07-7b84-4e1f-8d4b-d9cef864a996', 'a1228443-08f5-43a1-958f-3386e07084b2', '22e639a0-244c-460a-9455-6c7445548c8d', '8767abb2-fb0e-4f68-b582-a1549ab068be'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:23 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Delete snapshot completed successfully.
Apr 15 16:28:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e065f78-d164-49f0-ba94-23e787ca6549 tempest-SnapshotsActionsTest-1783338474 None] Lock "cinder-839a9632-0870-469f-8cb0-93b9718818e2-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Acquiring lock "cinder-0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Acquiring lock "cinder-quobyte-898455f9-33d8-45de-be7d-4d3ab7c78d16" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-quobyte-898455f9-33d8-45de-be7d-4d3ab7c78d16" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Acquiring lock "cinder-quobyte-0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-quobyte-0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Deleting offline snapshot 0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc of volume 898455f9-33d8-45de-be7d-4d3ab7c78d16 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] snapshot_file for this snap is: volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda3fb7-3ee9-47e6-aecd-ce45b17c6ca0]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:24 devstack sudo[84538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc
Apr 15 16:28:24 devstack sudo[84538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "cinder-998438b3-0664-4aa8-be7f-06f30b5b72f1-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-998438b3-0664-4aa8-be7f-06f30b5b72f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "cinder-quobyte-998438b3-0664-4aa8-be7f-06f30b5b72f1" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-quobyte-998438b3-0664-4aa8-be7f-06f30b5b72f1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Deleting offline snapshot 998438b3-0664-4aa8-be7f-06f30b5b72f1 of volume 5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] snapshot_file for this snap is: volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e226a9-a7ce-4d78-932e-cbe25725bc98]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:25 devstack sudo[84540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:25 devstack sudo[84540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:25 devstack sudo[84538]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc" returned: 0 in 0.735s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-898455f9-33d8-45de-be7d-4d3ab7c78d16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6698a15-c0ab-4581-8611-99c4c500a7a5]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:25 devstack sudo[84545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16
Apr 15 16:28:25 devstack sudo[84545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:25 devstack sudo[84540]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.643s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a58f04-7f65-4f16-bb68-964d1467ced0]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:26 devstack sudo[84551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd
Apr 15 16:28:26 devstack sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:26 devstack sudo[84545]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16" returned: 0 in 0.792s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:26 devstack sudo[84557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc
Apr 15 16:28:26 devstack sudo[84557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:26 devstack sudo[84551]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" returned: 0 in 0.970s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:26 devstack sudo[84565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:26 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:27 devstack sudo[84557]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc" returned: 0 in 0.716s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:27 devstack sudo[84567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc
Apr 15 16:28:27 devstack sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Flow 'volume_create_manager' (32a4dfa0-eb94-4364-9264-395bcf053e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55602a58-84d6-49bf-8a43-06f5c9d849f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55602a58-84d6-49bf-8a43-06f5c9d849f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1828190848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ede461-9ac5-434d-b72c-0e9718f7c612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af07fcb72b974c98a9239fdb08838095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:27Z,use_quota=True,user_id='67cc8722bffa427ba64036667c53ac93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab4745f-ee1f-4d61-ab03-ed7719fb7e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab4745f-ee1f-4d61-ab03-ed7719fb7e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe3ea9b-da7e-4afe-8067-eec06ff528da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe3ea9b-da7e-4afe-8067-eec06ff528da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ede461-9ac5-434d-b72c-0e9718f7c612', 'volume_name': 'volume-86ede461-9ac5-434d-b72c-0e9718f7c612', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49d8c60-39f8-4fae-b127-6cca41b44c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49d8c60-39f8-4fae-b127-6cca41b44c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6f8c3c-ce25-4132-8693-3d2d59547ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:27 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Volume 86ede461-9ac5-434d-b72c-0e9718f7c612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ede461-9ac5-434d-b72c-0e9718f7c612', 'volume_size': 1}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1828190848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ede461-9ac5-434d-b72c-0e9718f7c612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af07fcb72b974c98a9239fdb08838095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:27Z,use_quota=True,user_id='67cc8722bffa427ba64036667c53ac93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Creating volume 86ede461-9ac5-434d-b72c-0e9718f7c612 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:28:27 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:27 devstack sudo[84569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612 1073741824
Apr 15 16:28:27 devstack sudo[84569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:27 devstack sudo[84567]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16.0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc" returned: 0 in 0.648s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-quobyte-0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc" released by "_delete_snapshot" :: held 3.000s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-quobyte-898455f9-33d8-45de-be7d-4d3ab7c78d16" released by "delete_snapshot" :: held 3.035s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.quota [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Created reservations ['d7dceba0-8d22-4e1c-b8f0-81bc228d9ea4', '61d0a972-72fd-4baf-be12-85a36c9b1edc', '667e9375-3635-42ca-88c2-25dce143326e', '00f59ba0-636d-40f6-af5f-765d866bb01e'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:27 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 1.018s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:27 devstack sudo[84576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1
Apr 15 16:28:27 devstack sudo[84576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:27 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Delete snapshot completed successfully.
Apr 15 16:28:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-c6b855b7-981f-4025-a1c4-2ceb267bdd04 req-0ebee06b-3051-4b3a-8740-61756c06ed21 tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-0b0cbb9a-fdb7-4ee5-8a09-3f363c7fa4fc-delete_snapshot" released by "delete_snapshot" :: held 3.308s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:28 devstack sudo[84569]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612 1073741824" returned: 0 in 0.969s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:28 devstack sudo[84582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612
Apr 15 16:28:28 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:28 devstack sudo[84576]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd.998438b3-0664-4aa8-be7f-06f30b5b72f1" returned: 0 in 0.577s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-quobyte-998438b3-0664-4aa8-be7f-06f30b5b72f1" released by "_delete_snapshot" :: held 3.317s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" released by "delete_snapshot" :: held 3.344s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Created reservations ['1d0b4d3a-814e-4a15-b6a9-5997c0b1e335', 'b0b3d0d2-1c77-4872-bfc8-228aca495af4', '1f3d06c1-e060-4166-8e51-a99dd70c7616', 'efb74dfa-f2a6-4749-a658-316d0801c482'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:28 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Delete snapshot completed successfully.
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f64fc8f8-2503-41fb-b057-e2b2b8c04f56 tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-998438b3-0664-4aa8-be7f-06f30b5b72f1-delete_snapshot" released by "delete_snapshot" :: held 3.445s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:28 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612" returned: 0 in 0.433s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6f8c3c-ce25-4132-8693-3d2d59547ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ede461-9ac5-434d-b72c-0e9718f7c612', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07cb5cb-a2a0-4ffc-aae9-2eb66a0088af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:28 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Volume volume-86ede461-9ac5-434d-b72c-0e9718f7c612 (86ede461-9ac5-434d-b72c-0e9718f7c612): created successfully
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07cb5cb-a2a0-4ffc-aae9-2eb66a0088af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Flow 'volume_create_manager' (32a4dfa0-eb94-4364-9264-395bcf053e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:28 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7d4154a8-a1ca-4990-89c3-5d4b7f980b58 tempest-DeleteServersTestJSON-1257548813 None] Created volume successfully.
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Acquiring lock "cinder-898455f9-33d8-45de-be7d-4d3ab7c78d16-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-898455f9-33d8-45de-be7d-4d3ab7c78d16-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Acquiring lock "cinder-quobyte-898455f9-33d8-45de-be7d-4d3ab7c78d16" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-quobyte-898455f9-33d8-45de-be7d-4d3ab7c78d16" acquired by "delete_volume" :: waited 0.023s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b165ffd6-4348-47e9-a67f-30c96b2509db]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:29 devstack sudo[84597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16
Apr 15 16:28:29 devstack sudo[84597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "cinder-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" acquired by "delete_volume" :: waited 0.019s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[99987b3a-5891-4730-90bb-586c8d04d9ac]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:29 devstack sudo[84622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd
Apr 15 16:28:29 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:30 devstack sudo[84597]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16" returned: 0 in 1.074s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:30 devstack sudo[84652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16
Apr 15 16:28:30 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:30 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" returned: 0 in 0.866s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:30 devstack sudo[84656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd
Apr 15 16:28:30 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:30 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-898455f9-33d8-45de-be7d-4d3ab7c78d16" returned: 0 in 0.686s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-quobyte-898455f9-33d8-45de-be7d-4d3ab7c78d16" released by "delete_volume" :: held 1.797s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG cinder.quota [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Created reservations ['bcac3526-1f01-48dc-8ed2-c75413b52beb', 'b7dcf513-9d8d-45b0-bf8f-6594b7b18e88', 'ce0788d1-9269-493f-9d43-ad4f8f94d762', '4e4907a3-9b07-498c-a128-384f50eb47ae'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:30 devstack sudo[84660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:28:30 devstack sudo[84660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:30 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" returned: 0 in 0.570s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-quobyte-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd" released by "delete_volume" :: held 1.478s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Created reservations ['c22df921-c678-4046-ad01-d39116d46609', 'fbb9ef4e-c125-499d-8cd9-ecef96ba3dd0', '831df4ec-0f68-4361-8366-3fb68f42f088', '97da0990-d5ef-4928-b254-6e639a4a11dd'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:31 devstack sudo[84662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:28:31 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:31 devstack sudo[84660]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.427s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG cinder.manager [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:28:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Deleted volume successfully.
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-d84ff6ba-7512-438b-a207-6824b2d15dc2 req-21b1a6ff-e714-4c0d-89bd-3ea4a3d22b2f tempest-VolumesSnapshotsTestJSON-1335601633 None] Lock "cinder-898455f9-33d8-45de-be7d-4d3ab7c78d16-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:31 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.536s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:28:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Deleted volume successfully.
Apr 15 16:28:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2822a6cd-9544-4137-b66a-41672da38aec tempest-SnapshotsActionsTest-173340170 None] Lock "cinder-5e7cc417-dba0-4c2c-946d-0c1e9a82a3dd-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-03d5d977-c042-4918-ba36-3d45418d42f4 req-b79125f9-03aa-4b14-a4df-632af189783d tempest-DeleteServersTestJSON-1257548813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-03d5d977-c042-4918-ba36-3d45418d42f4 req-b79125f9-03aa-4b14-a4df-632af189783d tempest-DeleteServersTestJSON-1257548813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:33 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafee4c7-07ae-4875-bc6d-baa08041c4b8]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-03d5d977-c042-4918-ba36-3d45418d42f4 req-b79125f9-03aa-4b14-a4df-632af189783d tempest-DeleteServersTestJSON-1257548813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:33 devstack sudo[84708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612
Apr 15 16:28:33 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:33 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-03d5d977-c042-4918-ba36-3d45418d42f4 req-b79125f9-03aa-4b14-a4df-632af189783d tempest-DeleteServersTestJSON-1257548813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612" returned: 0 in 0.705s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-03d5d977-c042-4918-ba36-3d45418d42f4 req-b79125f9-03aa-4b14-a4df-632af189783d tempest-DeleteServersTestJSON-1257548813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.761s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-03d5d977-c042-4918-ba36-3d45418d42f4 req-b79125f9-03aa-4b14-a4df-632af189783d tempest-DeleteServersTestJSON-1257548813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6', 'name': 'volume-86ede461-9ac5-434d-b72c-0e9718f7c612', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d3eff99-4d99-4691-884d-4b0da94de1fa', 'enforce_multipath': True} {{(pid=82156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 16:28:33 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-03d5d977-c042-4918-ba36-3d45418d42f4 req-b79125f9-03aa-4b14-a4df-632af189783d tempest-DeleteServersTestJSON-1257548813 None] attachment_update completed successfully.
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Flow 'volume_create_manager' (76fe3498-c1b7-4f95-8af6-e2b28fd730a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6d7d09-ad50-45ea-a80d-de7ecdd1b1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6d7d09-ad50-45ea-a80d-de7ecdd1b1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-742262534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54cf5a5-3ece-42c5-9ecc-85b02e5ed002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83eb961666a464aaebeabe341a55985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:37Z,use_quota=True,user_id='44df9a46cded414b9d0163008174ae2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb885c0-2903-4147-882d-2985ff852f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb885c0-2903-4147-882d-2985ff852f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e6b88e-bc16-4a6b-b657-33835d52dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e6b88e-bc16-4a6b-b657-33835d52dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54cf5a5-3ece-42c5-9ecc-85b02e5ed002', 'volume_name': 'volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486d2633-dbe5-4ac3-9307-64a1960986df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486d2633-dbe5-4ac3-9307-64a1960986df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3032be08-c08b-464f-a14d-be0ab65a5fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:37 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Volume e54cf5a5-3ece-42c5-9ecc-85b02e5ed002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002', 'volume_size': 1}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-742262534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54cf5a5-3ece-42c5-9ecc-85b02e5ed002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83eb961666a464aaebeabe341a55985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:37Z,use_quota=True,user_id='44df9a46cded414b9d0163008174ae2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Creating volume e54cf5a5-3ece-42c5-9ecc-85b02e5ed002 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:28:37 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:37 devstack sudo[84724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002 1073741824
Apr 15 16:28:37 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:37 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002 1073741824" returned: 0 in 0.608s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:37 devstack sudo[84730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002
Apr 15 16:28:37 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e5cf8061-372d-4cc2-9ae2-b34b1e40a796 tempest-GroupSnapshotsTest-689663665 None] Group tempest-GroupSnapshotsTest-Group-1101365803: creating
Apr 15 16:28:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e5cf8061-372d-4cc2-9ae2-b34b1e40a796 tempest-GroupSnapshotsTest-689663665 None] Group tempest-GroupSnapshotsTest-Group-1101365803: created successfully
Apr 15 16:28:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e5cf8061-372d-4cc2-9ae2-b34b1e40a796 tempest-GroupSnapshotsTest-689663665 None] Create group completed successfully.
Apr 15 16:28:38 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002" returned: 0 in 0.501s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:28:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3032be08-c08b-464f-a14d-be0ab65a5fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0a01da-611f-449d-93a8-97c40737f571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:38 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Volume volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002 (e54cf5a5-3ece-42c5-9ecc-85b02e5ed002): created successfully
Apr 15 16:28:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0a01da-611f-449d-93a8-97c40737f571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Flow 'volume_create_manager' (76fe3498-c1b7-4f95-8af6-e2b28fd730a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:38 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-afa7bfcc-0757-4c19-81a8-be30ea34e245 tempest-VolumeQuotasAdminTestJSON-937583558 None] Created volume successfully.
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Flow 'volume_create_manager' (ec00f465-eed8-4235-a7c4-4d5de9099531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9b8cbf-fe20-41eb-a845-7391738c5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9b8cbf-fe20-41eb-a845-7391738c5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1536189985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ae0508f3-efca-4460-808e-650ab199a878,host='devstack@QuobyteHD#QuobyteHD',id=4e6db12c-344e-4e71-8c2f-e44c9668c415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da6d0f9a3b347989a373fbc929da826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:39Z,use_quota=True,user_id='6af1750fd1c748fe84ee1112f7a32c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6208216-c97a-4c11-9da1-41f15a870dbd),volume_type_id=a6208216-c97a-4c11-9da1-41f15a870dbd)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d059476f-94d2-4a4d-9d28-715d514148c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d059476f-94d2-4a4d-9d28-715d514148c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81de267c-78cc-42dc-a9a6-377a294a10cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81de267c-78cc-42dc-a9a6-377a294a10cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6db12c-344e-4e71-8c2f-e44c9668c415', 'volume_name': 'volume-4e6db12c-344e-4e71-8c2f-e44c9668c415', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf3c128-6654-423c-b410-13f45ec18a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf3c128-6654-423c-b410-13f45ec18a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bfef8b-1891-4dc0-acf4-6074b241c734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:39 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Volume 4e6db12c-344e-4e71-8c2f-e44c9668c415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6db12c-344e-4e71-8c2f-e44c9668c415', 'volume_size': 1}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ae0508f3-efca-4460-808e-650ab199a878,created_at=2026-04-15T14:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1536189985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ae0508f3-efca-4460-808e-650ab199a878,host='devstack@QuobyteHD#QuobyteHD',id=4e6db12c-344e-4e71-8c2f-e44c9668c415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da6d0f9a3b347989a373fbc929da826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:39Z,use_quota=True,user_id='6af1750fd1c748fe84ee1112f7a32c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6208216-c97a-4c11-9da1-41f15a870dbd),volume_type_id=a6208216-c97a-4c11-9da1-41f15a870dbd)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Creating volume 4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:28:39 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Acquiring lock "cinder-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:39 devstack sudo[84740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 1073741824
Apr 15 16:28:39 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "cinder-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Acquiring lock "cinder-quobyte-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "cinder-quobyte-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfdaf64-501e-4cdd-9529-54bebcee22cb]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:39 devstack sudo[84758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002
Apr 15 16:28:39 devstack sudo[84758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:40 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 1073741824" returned: 0 in 0.685s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:40 devstack sudo[84758]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002" returned: 0 in 0.605s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:40 devstack sudo[84784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002
Apr 15 16:28:40 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:40 devstack sudo[84787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415
Apr 15 16:28:40 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:40 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002" returned: 0 in 0.458s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "cinder-quobyte-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002" released by "delete_volume" :: held 1.109s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Created reservations ['ddc75437-0dee-45bf-b102-fc3b426b9d26', 'e2309d18-66ec-47f4-a26a-25a237cb21c6', 'bff00c2b-8a70-4cb6-9722-edab0bc63f1b', 'c651ff52-adaf-4690-b16a-8c8ccaafa51b'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:40 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415" returned: 0 in 0.518s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bfef8b-1891-4dc0-acf4-6074b241c734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6db12c-344e-4e71-8c2f-e44c9668c415', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d98f67-9582-4ae3-ae0c-2bb61652ada1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Volume volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 (4e6db12c-344e-4e71-8c2f-e44c9668c415): created successfully
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d98f67-9582-4ae3-ae0c-2bb61652ada1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Flow 'volume_create_manager' (ec00f465-eed8-4235-a7c4-4d5de9099531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:40 devstack sudo[84794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:28:40 devstack sudo[84794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:40 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d28cca13-0a1f-464a-b652-9b20af8f85ac tempest-GroupSnapshotsTest-689663665 None] Created volume successfully.
Apr 15 16:28:41 devstack sudo[84794]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:28:41 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Deleted volume successfully.
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f5a1768-2f14-4cd4-8848-4a266013960d tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "cinder-e54cf5a5-3ece-42c5-9ecc-85b02e5ed002-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:41 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] GroupSnapshot 6d659444-1e73-4eb1-975d-15ee320f25f3: creating.
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Group snapshot 6d659444-1e73-4eb1-975d-15ee320f25f3: creating. {{(pid=82156) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Creating offline snapshot d1750d7c-9870-49de-9b4c-7a6d22ef6e5e of volume 4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9f07a6-20ba-4cb8-960a-4378954e9acb]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:41 devstack sudo[84799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415
Apr 15 16:28:41 devstack sudo[84799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Flow 'volume_create_manager' (211fed9b-9309-4837-ab00-dff1672e27d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07070c79-1154-4aa6-9b0a-3b64c7065440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07070c79-1154-4aa6-9b0a-3b64c7065440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-711900740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eebb82-26b4-4cd4-9225-14a91094bb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83eb961666a464aaebeabe341a55985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:42Z,use_quota=True,user_id='44df9a46cded414b9d0163008174ae2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf4f1ea-0b6b-4a45-8564-2ee09f9883a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf4f1ea-0b6b-4a45-8564-2ee09f9883a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17de62e4-f4cf-4991-ba18-0e52b09a3610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17de62e4-f4cf-4991-ba18-0e52b09a3610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8eebb82-26b4-4cd4-9225-14a91094bb26', 'volume_name': 'volume-d8eebb82-26b4-4cd4-9225-14a91094bb26', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985d88de-b8d7-4def-a257-ea793354a4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985d88de-b8d7-4def-a257-ea793354a4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba45c95-680f-4732-88fb-cd41a180a810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:41 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Volume d8eebb82-26b4-4cd4-9225-14a91094bb26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8eebb82-26b4-4cd4-9225-14a91094bb26', 'volume_size': 1}
Apr 15 16:28:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:42 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-1797a9ec-96fb-42cf-80e2-44ea26340cab req-c8585847-1b99-48dd-b095-4e3daab81957 tempest-DeleteServersTestJSON-1257548813 None] Terminate volume connection completed successfully.
Apr 15 16:28:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-1797a9ec-96fb-42cf-80e2-44ea26340cab req-c8585847-1b99-48dd-b095-4e3daab81957 tempest-DeleteServersTestJSON-1257548813 None] Deleting attachment 6d3eff99-4d99-4691-884d-4b0da94de1fa. {{(pid=82156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 16:28:42 devstack sudo[84799]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415" returned: 0 in 0.529s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:42 devstack sudo[84805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e 1G
Apr 15 16:28:42 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:42 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e 1G" returned: 0 in 0.467s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:42 devstack sudo[84810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e
Apr 15 16:28:42 devstack sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:43 devstack sudo[84810]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e" returned: 0 in 0.428s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:43 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:28:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:43 devstack sudo[84818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e
Apr 15 16:28:43 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:43 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e" returned: 0 in 0.465s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:43 devstack sudo[84821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.info
Apr 15 16:28:43 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:43 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.info" returned: 0 in 0.444s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:43 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:28:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:43 devstack sudo[84824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.info
Apr 15 16:28:43 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:44 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.info" returned: 0 in 0.559s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.956s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.628s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-711900740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eebb82-26b4-4cd4-9225-14a91094bb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83eb961666a464aaebeabe341a55985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:28:42Z,use_quota=True,user_id='44df9a46cded414b9d0163008174ae2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Creating volume d8eebb82-26b4-4cd4-9225-14a91094bb26 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:28:44 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:28:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:44 devstack sudo[84853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26 1073741824
Apr 15 16:28:44 devstack sudo[84853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-31f22d63-3a27-454d-b1b0-9a7f0988e209 tempest-GroupSnapshotsTest-689663665 None] group_snapshot 6d659444-1e73-4eb1-975d-15ee320f25f3: created successfully
Apr 15 16:28:45 devstack sudo[84853]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26 1073741824" returned: 0 in 0.711s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:45 devstack sudo[84861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26
Apr 15 16:28:45 devstack sudo[84861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Acquiring lock "cinder-86ede461-9ac5-434d-b72c-0e9718f7c612-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Lock "cinder-86ede461-9ac5-434d-b72c-0e9718f7c612-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Acquiring lock "cinder-quobyte-86ede461-9ac5-434d-b72c-0e9718f7c612" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Lock "cinder-quobyte-86ede461-9ac5-434d-b72c-0e9718f7c612" acquired by "delete_volume" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce91762e-5f5d-4fbe-9127-659afe350c62]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:45 devstack sudo[84861]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26" returned: 0 in 0.600s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba45c95-680f-4732-88fb-cd41a180a810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8eebb82-26b4-4cd4-9225-14a91094bb26', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0981f6c4-0355-4ac2-902d-58d73d6a6579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:28:45 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Volume volume-d8eebb82-26b4-4cd4-9225-14a91094bb26 (d8eebb82-26b4-4cd4-9225-14a91094bb26): created successfully
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0981f6c4-0355-4ac2-902d-58d73d6a6579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:28:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Flow 'volume_create_manager' (211fed9b-9309-4837-ab00-dff1672e27d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:28:45 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e9937533-f070-4b61-aac6-118398772ad3 tempest-VolumeQuotasAdminTestJSON-937583558 None] Created volume successfully.
Apr 15 16:28:45 devstack sudo[84864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612
Apr 15 16:28:45 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:46 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612" returned: 0 in 0.584s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:46 devstack sudo[84869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612
Apr 15 16:28:46 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:46 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ff72cf19-e100-4f47-b102-90eb0d0930d6 tempest-VolumeQuotasAdminTestJSON-1585797534 None] Transfer volume completed successfully.
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-d1750d7c-9870-49de-9b4c-7a6d22ef6e5e-a9fd7658-34a0-46dc-953e-2fbd147b9a29" by "_create_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-d1750d7c-9870-49de-9b4c-7a6d22ef6e5e-a9fd7658-34a0-46dc-953e-2fbd147b9a29" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Creating volume a9fd7658-34a0-46dc-953e-2fbd147b9a29 from snapshot d1750d7c-9870-49de-9b4c-7a6d22ef6e5e {{(pid=82156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-a9fd7658-34a0-46dc-953e-2fbd147b9a29" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-a9fd7658-34a0-46dc-953e-2fbd147b9a29" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] snapshot: d1750d7c-9870-49de-9b4c-7a6d22ef6e5e, volume: a9fd7658-34a0-46dc-953e-2fbd147b9a29,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[781c5dcf-bda2-4392-8dcf-53358ce69809]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:46 devstack sudo[84873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e
Apr 15 16:28:46 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:46 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86ede461-9ac5-434d-b72c-0e9718f7c612" returned: 0 in 0.569s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Lock "cinder-quobyte-86ede461-9ac5-434d-b72c-0e9718f7c612" released by "delete_volume" :: held 1.198s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Created reservations ['30d869d8-bbca-4fe1-89f4-368e86810afa', 'f3caeade-bcca-4eeb-9ae4-e19642046d26', 'c327fbe8-874c-40fe-ae64-e194496ce6de', '4d9009fc-57ae-4667-9c9a-7a9b738153e3'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:47 devstack sudo[84875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:28:47 devstack sudo[84875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Acquiring lock "cinder-d8eebb82-26b4-4cd4-9225-14a91094bb26-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Lock "cinder-d8eebb82-26b4-4cd4-9225-14a91094bb26-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Acquiring lock "cinder-quobyte-d8eebb82-26b4-4cd4-9225-14a91094bb26" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Lock "cinder-quobyte-d8eebb82-26b4-4cd4-9225-14a91094bb26" acquired by "delete_volume" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc009b87-5658-4824-ba9f-92977bd98294]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:47 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e" returned: 0 in 0.718s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6db12c-344e-4e71-8c2f-e44c9668c415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3c78a7-ce3a-4c36-a825-48210512b2e6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:47 devstack sudo[84881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26
Apr 15 16:28:47 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:47 devstack sudo[84882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415
Apr 15 16:28:47 devstack sudo[84882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:47 devstack sudo[84875]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.652s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:28:47 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Deleted volume successfully.
Apr 15 16:28:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a16fd5a2-17f3-4be1-a37f-9ac1b6cad752 tempest-DeleteServersTestJSON-1257548813 None] Lock "cinder-86ede461-9ac5-434d-b72c-0e9718f7c612-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:48 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26" returned: 0 in 0.654s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:48 devstack sudo[84895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26
Apr 15 16:28:48 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:48 devstack sudo[84882]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415" returned: 0 in 0.643s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:48 devstack sudo[84897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29
Apr 15 16:28:48 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:48 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d8eebb82-26b4-4cd4-9225-14a91094bb26" returned: 0 in 0.509s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Lock "cinder-quobyte-d8eebb82-26b4-4cd4-9225-14a91094bb26" released by "delete_volume" :: held 1.193s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Created reservations ['23f36a8d-183e-48e7-8333-9f6f3376f55d', 'cf814f0e-38b5-494f-9135-63c3dfeb6fca', '7aac499f-237b-46b0-82bd-bc0e97704eb9', '90019690-478e-42c0-a153-b116f201ff62'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:48 devstack sudo[84911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:28:48 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:28:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:49 devstack sudo[84915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:28:49 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:51 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 2.430s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:51 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:28:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Deleted volume successfully.
Apr 15 16:28:51 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 1.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:51 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:28:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d7d182bf-b021-4f4e-9c69-5d09b73e99b5 tempest-VolumeQuotasAdminTestJSON-449023197 None] Lock "cinder-d8eebb82-26b4-4cd4-9225-14a91094bb26-delete_volume" released by "delete_volume" :: held 3.870s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:51 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29" returned: 0 in 3.096s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:51 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed4a6ca-79cc-4e1b-a377-0c2b09b94996]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:51 devstack sudo[84921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415
Apr 15 16:28:51 devstack sudo[84921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:52 devstack sudo[84921]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415" returned: 0 in 0.881s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:52 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415, size 1024.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:28:52 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Converted 1024.00 MB image at 330.61 MB/s
Apr 15 16:28:52 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:28:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:52 devstack sudo[84942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29
Apr 15 16:28:52 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:52 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29" returned: 0 in 0.612s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-a9fd7658-34a0-46dc-953e-2fbd147b9a29" released by "_copy_volume_from_snapshot" :: held 6.027s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-d1750d7c-9870-49de-9b4c-7a6d22ef6e5e-a9fd7658-34a0-46dc-953e-2fbd147b9a29" released by "_create_volume_from_snapshot" :: held 6.052s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.065s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9f309a67-b682-4e39-b48d-4725f8aa64a9 tempest-GroupSnapshotsTest-689663665 None] Create group from source-snapshot-6d659444-1e73-4eb1-975d-15ee320f25f3 completed successfully.
Apr 15 16:28:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-a9fd7658-34a0-46dc-953e-2fbd147b9a29" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-a9fd7658-34a0-46dc-953e-2fbd147b9a29" acquired by "delete_volume" :: waited 0.027s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:54 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b06ac4-5520-4b5a-8368-d74da7a2c0df]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:54 devstack sudo[84950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29
Apr 15 16:28:54 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:55 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29" returned: 0 in 0.698s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:55 devstack sudo[84955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29
Apr 15 16:28:55 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:55 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a9fd7658-34a0-46dc-953e-2fbd147b9a29" returned: 0 in 0.848s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-a9fd7658-34a0-46dc-953e-2fbd147b9a29" released by "delete_volume" :: held 1.602s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Created reservations ['8d7bcc36-df81-4e48-bc36-1744da72b589'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:56 devstack cinder-volume[82156]: WARNING cinder.quota [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1635695218 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1635695218, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:28:56 devstack cinder-volume[82156]: WARNING cinder.quota [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1635695218 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1635695218, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Created reservations ['9646ce27-3699-4953-a168-b1a84e017bc5', '9d62de96-efb1-46ed-a0db-db68a083dd62', '2a7e9755-af19-4f88-b0ee-b8db7dd3423e', '4abf5d6d-14b9-4a49-bd96-48318174176a'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:56 devstack sudo[84958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:28:56 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:56 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] group_snapshot 6d659444-1e73-4eb1-975d-15ee320f25f3: deleting
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] group_snapshot 6d659444-1e73-4eb1-975d-15ee320f25f3: deleting {{(pid=82156) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-4e6db12c-344e-4e71-8c2f-e44c9668c415" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-4e6db12c-344e-4e71-8c2f-e44c9668c415" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-d1750d7c-9870-49de-9b4c-7a6d22ef6e5e" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-d1750d7c-9870-49de-9b4c-7a6d22ef6e5e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Deleting offline snapshot d1750d7c-9870-49de-9b4c-7a6d22ef6e5e of volume 4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] snapshot_file for this snap is: volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[520533dd-7e2c-446a-a65d-d5d6e09ebefa]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:57 devstack sudo[84960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e
Apr 15 16:28:57 devstack sudo[84960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:57 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 1.089s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:57 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:28:57 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-06c2a31b-44b0-4e81-82ff-43841c3cf923 tempest-GroupSnapshotsTest-689663665 None] Delete group completed successfully.
Apr 15 16:28:57 devstack sudo[84960]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e" returned: 0 in 0.832s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6db12c-344e-4e71-8c2f-e44c9668c415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:28:57 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c64083e-1d86-432b-8f60-e83eddac9f37]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:28:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:57 devstack sudo[84973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415
Apr 15 16:28:57 devstack sudo[84973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:58 devstack sudo[84973]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415" returned: 0 in 0.750s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:58 devstack sudo[84978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e
Apr 15 16:28:58 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:59 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e" returned: 0 in 0.707s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:28:59 devstack sudo[84983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e
Apr 15 16:28:59 devstack sudo[84983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:28:59 devstack sudo[84983]: pam_unix(sudo:session): session closed for user root
Apr 15 16:28:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415.d1750d7c-9870-49de-9b4c-7a6d22ef6e5e" returned: 0 in 0.701s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:28:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-d1750d7c-9870-49de-9b4c-7a6d22ef6e5e" released by "_delete_snapshot" :: held 3.077s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:28:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-4e6db12c-344e-4e71-8c2f-e44c9668c415" released by "delete_snapshot" :: held 3.093s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:00 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:DELETE=9,cinder:SELECT=105,cinder:UPDATE=113,cinder:INSERT=31 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:29:00 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=119,cinder:UPDATE=112,cinder:INSERT=25,cinder:DELETE=6 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:29:00 devstack cinder-volume[82156]: WARNING cinder.quota [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1635695218 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1635695218, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:29:00 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] Created reservations ['c6955c19-50ca-4294-b762-285ed13cac72', 'c7cdbfa4-4249-4f0e-a2c7-985ac5072d74', 'e980be83-823c-4e51-b6e8-e915e79b7d6c', 'd586d616-0f1e-4f8a-ac96-e3a9a528d362'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:00 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-70854af8-e687-4b66-a8c5-170a38b1c766 tempest-GroupSnapshotsTest-689663665 None] group_snapshot 6d659444-1e73-4eb1-975d-15ee320f25f3: deleted successfully
Apr 15 16:29:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-4e6db12c-344e-4e71-8c2f-e44c9668c415" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-4e6db12c-344e-4e71-8c2f-e44c9668c415" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:01 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[92175eb3-a067-4048-b95b-fa24f02fc0d7]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:01 devstack sudo[84986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415
Apr 15 16:29:01 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:02 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415" returned: 0 in 0.702s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:02 devstack sudo[84991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415
Apr 15 16:29:02 devstack sudo[84991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:02 devstack sudo[84991]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4e6db12c-344e-4e71-8c2f-e44c9668c415" returned: 0 in 0.756s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:02 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-4e6db12c-344e-4e71-8c2f-e44c9668c415" released by "delete_volume" :: held 1.503s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:02 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Created reservations ['93c26fc2-0c54-4efd-801a-8127d9c381f6'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:02 devstack cinder-volume[82156]: WARNING cinder.db.sqlalchemy.api [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1635695218']
Apr 15 16:29:02 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Created reservations ['fba5bd78-8c36-432a-b49f-e01cf680022b', '4beecd8f-d0f6-473f-b770-672ee3979caf', 'bddc9362-fd1d-4c19-8b64-ef0389ae85b7', '39182011-772e-4330-881f-3aa82a2c08e8'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:03 devstack sudo[84995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:29:03 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Flow 'volume_create_manager' (4e232b1a-1bb2-447b-ae9c-b6a15b9dbf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaef018-5cf5-4b92-b334-ef9dff3b7f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:04 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 1.088s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaef018-5cf5-4b92-b334-ef9dff3b7f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:29:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8d48b7-cd9a-423d-acf4-b68428d002f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54446f9f53c741f2baecd3b4e368eade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:04Z,use_quota=True,user_id='aff43bb17a0a4a978bb30f06bb6320c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76cf48d-6a84-4b83-886d-6c6af49c754a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76cf48d-6a84-4b83-886d-6c6af49c754a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4703d7-105d-4f1a-a152-f08e779b5487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.image.glance [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Creating Keystone auth plugin from conf {{(pid=82156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 16:29:04 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-553b12e5-50c6-439b-9e60-444cc8460a9f tempest-GroupSnapshotsTest-689663665 None] Delete group completed successfully.
Apr 15 16:29:04 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-12e4086b-ac56-47be-b871-f7b454551a71 tempest-GroupSnapshotsTest-689663665 None] Group tempest-GroupSnapshotsTest-Group-1186224968: creating
Apr 15 16:29:04 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-12e4086b-ac56-47be-b871-f7b454551a71 tempest-GroupSnapshotsTest-689663665 None] Group tempest-GroupSnapshotsTest-Group-1186224968: created successfully
Apr 15 16:29:04 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-12e4086b-ac56-47be-b871-f7b454551a71 tempest-GroupSnapshotsTest-689663665 None] Create group completed successfully.
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4703d7-105d-4f1a-a152-f08e779b5487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a8d48b7-cd9a-423d-acf4-b68428d002f7', 'volume_name': 'volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8e970d240>}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6023bf48-c00c-4c14-a28a-b87b168698bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6023bf48-c00c-4c14-a28a-b87b168698bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e47354-c4b6-4154-bedd-9facf40bff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:04 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Volume 1a8d48b7-cd9a-423d-acf4-b68428d002f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8e970d240>}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Trying to clone 1a8d48b7-cd9a-423d-acf4-b68428d002f7 from image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]). {{(pid=82156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 16:29:04 devstack cinder-volume[82156]: INFO cinder.image.image_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f79baa0-bf8a-4c05-89c0-38d6570e3c8a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:05 devstack sudo[85037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD
Apr 15 16:29:05 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:05 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:05 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Temporary image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 is fetched for user aff43bb17a0a4a978bb30f06bb6320c2. {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 16:29:05 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d7d1c-adce-49a7-be4e-18107d27f2c7]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Flow 'volume_create_manager' (997a8787-f6c4-4194-bcf8-1410445e8690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b186e830-d096-491a-bd0f-33d60994e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b186e830-d096-491a-bd0f-33d60994e291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-811110749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a023cc1d-a263-4e12-acfb-c5f512b14f13,host='devstack@QuobyteHD#QuobyteHD',id=74f61be8-6054-415f-902f-8c4b2b0d413f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da6d0f9a3b347989a373fbc929da826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:06Z,use_quota=True,user_id='6af1750fd1c748fe84ee1112f7a32c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3731c687-1b65-4f64-9a83-fb776f9a51c9),volume_type_id=3731c687-1b65-4f64-9a83-fb776f9a51c9)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acd0c49-7556-4805-8b39-fbad5890faf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acd0c49-7556-4805-8b39-fbad5890faf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544bd20b-0b37-4763-885a-37365aacbfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544bd20b-0b37-4763-885a-37365aacbfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f61be8-6054-415f-902f-8c4b2b0d413f', 'volume_name': 'volume-74f61be8-6054-415f-902f-8c4b2b0d413f', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ba9a0e-e965-4123-94e8-2a4bc3f32b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ba9a0e-e965-4123-94e8-2a4bc3f32b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df37ffdc-930a-4fb7-996e-2b18126cd7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:06 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Volume 74f61be8-6054-415f-902f-8c4b2b0d413f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f61be8-6054-415f-902f-8c4b2b0d413f', 'volume_size': 1}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a023cc1d-a263-4e12-acfb-c5f512b14f13,created_at=2026-04-15T14:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-811110749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a023cc1d-a263-4e12-acfb-c5f512b14f13,host='devstack@QuobyteHD#QuobyteHD',id=74f61be8-6054-415f-902f-8c4b2b0d413f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da6d0f9a3b347989a373fbc929da826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:06Z,use_quota=True,user_id='6af1750fd1c748fe84ee1112f7a32c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3731c687-1b65-4f64-9a83-fb776f9a51c9),volume_type_id=3731c687-1b65-4f64-9a83-fb776f9a51c9)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Creating volume 74f61be8-6054-415f-902f-8c4b2b0d413f {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:29:06 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:29:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:06 devstack sudo[85052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f 1073741824
Apr 15 16:29:06 devstack sudo[85052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:06 devstack sudo[85051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD
Apr 15 16:29:06 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:07 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD" returned: 0 in 1.545s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:07 devstack sudo[85052]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f 1073741824" returned: 0 in 1.305s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:07 devstack sudo[85068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f
Apr 15 16:29:07 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:08 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f" returned: 0 in 0.649s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:29:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8d48b7-cd9a-423d-acf4-b68428d002f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54446f9f53c741f2baecd3b4e368eade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:04Z,use_quota=True,user_id='aff43bb17a0a4a978bb30f06bb6320c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Creating volume 1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:29:08 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df37ffdc-930a-4fb7-996e-2b18126cd7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f61be8-6054-415f-902f-8c4b2b0d413f', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1627e68-4e93-445b-9b84-e9cbaa6fa223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:08 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Volume volume-74f61be8-6054-415f-902f-8c4b2b0d413f (74f61be8-6054-415f-902f-8c4b2b0d413f): created successfully
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1627e68-4e93-445b-9b84-e9cbaa6fa223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Flow 'volume_create_manager' (997a8787-f6c4-4194-bcf8-1410445e8690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:08 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-0e3d6947-58b2-40ac-b2a4-f4d22e8c8cfe tempest-GroupSnapshotsTest-689663665 None] Created volume successfully.
Apr 15 16:29:08 devstack sudo[85073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 1073741824
Apr 15 16:29:08 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Flow 'volume_create_manager' (651d8c5e-5d15-43d3-a504-783d6d47f416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadb9aef-7328-4cbe-9e5d-6747f23d63f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadb9aef-7328-4cbe-9e5d-6747f23d63f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-151911765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a023cc1d-a263-4e12-acfb-c5f512b14f13,host='devstack@QuobyteHD#QuobyteHD',id=e2b1b7c6-7a02-42d1-b3c1-65ed63db2913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da6d0f9a3b347989a373fbc929da826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:09Z,use_quota=True,user_id='6af1750fd1c748fe84ee1112f7a32c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3731c687-1b65-4f64-9a83-fb776f9a51c9),volume_type_id=3731c687-1b65-4f64-9a83-fb776f9a51c9)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c0f9a9-6861-438d-82fc-6d62a934b072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c0f9a9-6861-438d-82fc-6d62a934b072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909b9d57-c94b-4997-8a11-73799e7ea2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909b9d57-c94b-4997-8a11-73799e7ea2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b1b7c6-7a02-42d1-b3c1-65ed63db2913', 'volume_name': 'volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3836ec9c-5b5d-418b-926e-6135969c0acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3836ec9c-5b5d-418b-926e-6135969c0acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03052557-ff4f-4154-8000-cf7344e6524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:09 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Volume e2b1b7c6-7a02-42d1-b3c1-65ed63db2913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913', 'volume_size': 1}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:09 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 1073741824" returned: 0 in 1.023s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:09 devstack sudo[85083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7
Apr 15 16:29:09 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:10 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7" returned: 0 in 0.740s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a023cc1d-a263-4e12-acfb-c5f512b14f13,created_at=2026-04-15T14:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-151911765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a023cc1d-a263-4e12-acfb-c5f512b14f13,host='devstack@QuobyteHD#QuobyteHD',id=e2b1b7c6-7a02-42d1-b3c1-65ed63db2913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da6d0f9a3b347989a373fbc929da826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:09Z,use_quota=True,user_id='6af1750fd1c748fe84ee1112f7a32c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3731c687-1b65-4f64-9a83-fb776f9a51c9),volume_type_id=3731c687-1b65-4f64-9a83-fb776f9a51c9)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Creating volume e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:29:10 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Attempting download of 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}])) to volume 1a8d48b7-cd9a-423d-acf4-b68428d002f7. {{(pid=82156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 16:29:10 devstack sudo[85087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 1073741824
Apr 15 16:29:10 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dd2060-afb4-4766-baf4-44f7b6a21297]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_4lsb0bzq {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:10 devstack sudo[85091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_4lsb0bzq
Apr 15 16:29:10 devstack sudo[85091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:10 devstack sudo[85091]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_4lsb0bzq" returned: 0 in 0.688s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_4lsb0bzq {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:10 devstack sudo[85107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_4lsb0bzq
Apr 15 16:29:10 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:10 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 1073741824" returned: 0 in 0.922s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:11 devstack sudo[85110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913
Apr 15 16:29:11 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:11 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_4lsb0bzq" returned: 1 in 0.788s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_4lsb0bzq' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e19c31d-5926-4bfd-a6c6-46cdf5fe6fb6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:11 devstack sudo[85114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD
Apr 15 16:29:11 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:11 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" returned: 0 in 0.747s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03052557-ff4f-4154-8000-cf7344e6524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36903f2-35a1-4396-b75b-aa4997daf9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:11 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Volume volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 (e2b1b7c6-7a02-42d1-b3c1-65ed63db2913): created successfully
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36903f2-35a1-4396-b75b-aa4997daf9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Flow 'volume_create_manager' (651d8c5e-5d15-43d3-a504-783d6d47f416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:11 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1e6a50cf-dc21-4a7f-9562-995da00da857 tempest-GroupSnapshotsTest-689663665 None] Created volume successfully.
Apr 15 16:29:12 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:12 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 was qcow2, converting to raw {{(pid=82156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 16:29:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:12 devstack sudo[85120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7
Apr 15 16:29:12 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:12 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9230434d-26f5-47ec-b709-68e7a771cb87 tempest-GroupSnapshotsTest-689663665 None] Update group completed successfully.
Apr 15 16:29:13 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7" returned: 0 in 1.306s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:13 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_snfkfsbhdevstack@QuobyteHD, size 112.00 MB, duration 1.31 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:29:13 devstack cinder-volume[82156]: INFO cinder.image.image_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Converted 112.00 MB image at 85.67 MB/s
Apr 15 16:29:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:13 devstack sudo[85139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 1G
Apr 15 16:29:13 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:13 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3fc791b4-3c48-4da4-a510-20a55f32b42a tempest-GroupSnapshotsTest-689663665 None] Update group completed successfully.
Apr 15 16:29:14 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-67ef3b8d-de25-4008-932d-d12a245f20a1 tempest-GroupSnapshotsTest-689663665 None] Update group completed successfully.
Apr 15 16:29:14 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 1G" returned: 0 in 1.091s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:14 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7656f171-dc9c-4103-a4a2-8f851e49be2c]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:14 devstack sudo[85144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7
Apr 15 16:29:14 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:15 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7" returned: 0 in 0.775s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:15 devstack sudo[85155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7
Apr 15 16:29:15 devstack sudo[85155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3c250cd4-e191-450b-bf46-219730c04db7 tempest-GroupSnapshotsTest-689663665 None] Update group completed successfully.
Apr 15 16:29:16 devstack sudo[85155]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7" returned: 1 in 0.670s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Downloaded image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}])) to volume 1a8d48b7-cd9a-423d-acf4-b68428d002f7 successfully. {{(pid=82156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Temporary image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 for user aff43bb17a0a4a978bb30f06bb6320c2 is deleted. {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Marking volume 1a8d48b7-cd9a-423d-acf4-b68428d002f7 as bootable. {{(pid=82156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Copying metadata from image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 to 1a8d48b7-cd9a-423d-acf4-b68428d002f7. {{(pid=82156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Creating volume glance metadata for volume 1a8d48b7-cd9a-423d-acf4-b68428d002f7 backed by image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e47354-c4b6-4154-bedd-9facf40bff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8e970d240>}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda0931a-828c-4ed4-824f-5deb4b173dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:16 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Volume volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 (1a8d48b7-cd9a-423d-acf4-b68428d002f7): created successfully
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda0931a-828c-4ed4-824f-5deb4b173dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Flow 'volume_create_manager' (4e232b1a-1bb2-447b-ae9c-b6a15b9dbf4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:16 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-ae1e688a-c053-49a1-8b73-a06e1bc87650 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Created volume successfully.
Apr 15 16:29:16 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] GroupSnapshot f0e886d7-91a5-4391-a06e-2e9ed1cf1778: creating.
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Group snapshot f0e886d7-91a5-4391-a06e-2e9ed1cf1778: creating. {{(pid=82156) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Creating offline snapshot 5bc615a3-2a0d-45cb-b347-77402b0a55c6 of volume 74f61be8-6054-415f-902f-8c4b2b0d413f {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5df33f-4cf8-4ac8-b86a-b1990f05fe40]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:16 devstack sudo[85179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f
Apr 15 16:29:16 devstack sudo[85179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:17 devstack sudo[85179]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f" returned: 0 in 0.618s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:17 devstack sudo[85185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 1G
Apr 15 16:29:17 devstack sudo[85185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:18 devstack sudo[85185]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 1G" returned: 0 in 0.563s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f61be8-6054-415f-902f-8c4b2b0d413f -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:18 devstack sudo[85190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f61be8-6054-415f-902f-8c4b2b0d413f -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6
Apr 15 16:29:18 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:18 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f61be8-6054-415f-902f-8c4b2b0d413f -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6" returned: 0 in 0.512s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:18 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:29:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:18 devstack sudo[85195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6
Apr 15 16:29:18 devstack sudo[85195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:18 devstack sudo[85195]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:19 devstack sudo[85201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.info
Apr 15 16:29:19 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:19 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.info" returned: 0 in 0.424s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:19 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:29:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:19 devstack sudo[85204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.info
Apr 15 16:29:19 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:19 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.info" returned: 0 in 0.500s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.168s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:19 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Creating offline snapshot 7029d646-dc2f-4656-b21d-75ce9a1c121d of volume e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:29:19 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8f0ab3-2918-43c4-9c21-f535bccb3edf]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:20 devstack sudo[85207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913
Apr 15 16:29:20 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:20 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" returned: 0 in 0.562s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:20 devstack sudo[85237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d 1G
Apr 15 16:29:20 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:21 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d 1G" returned: 0 in 0.699s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:21 devstack sudo[85244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d
Apr 15 16:29:21 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:21 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d" returned: 0 in 0.496s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:21 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:29:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:21 devstack sudo[85249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d
Apr 15 16:29:21 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:22 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d" returned: 0 in 0.565s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:22 devstack sudo[85252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.info
Apr 15 16:29:22 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:22 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.info" returned: 0 in 0.454s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:22 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:29:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:22 devstack sudo[85255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.info
Apr 15 16:29:22 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:23 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.info" returned: 0 in 0.509s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.343s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.443s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:23 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c9013c-4e0b-4bcc-aa75-d6eb27b4a198]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:23 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-45bd7705-fa86-4d9c-b75a-1ecfc7e2e233 tempest-GroupSnapshotsTest-689663665 None] group_snapshot f0e886d7-91a5-4391-a06e-2e9ed1cf1778: created successfully
Apr 15 16:29:23 devstack sudo[85258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7
Apr 15 16:29:23 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:23 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7" returned: 0 in 0.583s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:24 devstack sudo[85262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7
Apr 15 16:29:24 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:24 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] group_snapshot f0e886d7-91a5-4391-a06e-2e9ed1cf1778: deleting
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] group_snapshot f0e886d7-91a5-4391-a06e-2e9ed1cf1778: deleting {{(pid=82156) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-74f61be8-6054-415f-902f-8c4b2b0d413f" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-74f61be8-6054-415f-902f-8c4b2b0d413f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-5bc615a3-2a0d-45cb-b347-77402b0a55c6" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-5bc615a3-2a0d-45cb-b347-77402b0a55c6" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Deleting offline snapshot 5bc615a3-2a0d-45cb-b347-77402b0a55c6 of volume 74f61be8-6054-415f-902f-8c4b2b0d413f {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] snapshot_file for this snap is: volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c01e9d-4576-430a-9896-d23f8a1661b9]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:24 devstack sudo[85264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6
Apr 15 16:29:24 devstack sudo[85264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:24 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7" returned: 1 in 0.586s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.201s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6', 'name': 'volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b8e9e84-8022-4e3d-b0dc-9fec4fa0a56e', 'enforce_multipath': True} {{(pid=82156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 16:29:24 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-90b4be11-ee89-44cb-98ab-2c0d79200a83 req-eb01012a-1b9f-4a46-a218-c610c5d99eb0 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] attachment_update completed successfully.
Apr 15 16:29:24 devstack sudo[85264]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6" returned: 0 in 0.717s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74f61be8-6054-415f-902f-8c4b2b0d413f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:29:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[47014188-4dba-486d-9744-cb32efb4babc]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:25 devstack sudo[85277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f
Apr 15 16:29:25 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:25 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f" returned: 0 in 0.811s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:25 devstack sudo[85286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6
Apr 15 16:29:25 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:26 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6" returned: 0 in 0.808s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:26 devstack sudo[85292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6
Apr 15 16:29:26 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:27 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f.5bc615a3-2a0d-45cb-b347-77402b0a55c6" returned: 0 in 0.602s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-5bc615a3-2a0d-45cb-b347-77402b0a55c6" released by "_delete_snapshot" :: held 3.039s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-74f61be8-6054-415f-902f-8c4b2b0d413f" released by "delete_snapshot" :: held 3.050s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-7029d646-dc2f-4656-b21d-75ce9a1c121d" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-7029d646-dc2f-4656-b21d-75ce9a1c121d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Deleting offline snapshot 7029d646-dc2f-4656-b21d-75ce9a1c121d of volume e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] snapshot_file for this snap is: volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bcdfac-83d6-4bea-a37a-0c366d96dc15]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:27 devstack sudo[85299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d
Apr 15 16:29:27 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:27 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d" returned: 0 in 0.623s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b9d85-dde4-4e08-bb7c-ef3d7b4bac65]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:28 devstack sudo[85309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913
Apr 15 16:29:28 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:28 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" returned: 0 in 0.595s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:28 devstack sudo[85314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d
Apr 15 16:29:28 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:29 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d" returned: 0 in 0.671s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:29 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d
Apr 15 16:29:29 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:29 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913.7029d646-dc2f-4656-b21d-75ce9a1c121d" returned: 0 in 0.575s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-7029d646-dc2f-4656-b21d-75ce9a1c121d" released by "_delete_snapshot" :: held 2.538s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" released by "delete_snapshot" :: held 2.550s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:29 devstack cinder-volume[82156]: WARNING cinder.quota [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1431396558 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1431396558, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:29:29 devstack cinder-volume[82156]: WARNING cinder.quota [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1431396558 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1431396558, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:29:29 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Created reservations ['c02fca92-dd68-4c3a-95d6-00155d50efa2', '258c6878-92d9-4d55-adaf-e19d9c693207', 'f9e423bf-31bb-4283-8704-2c2c0ab01562', '8a5446a7-7107-4b0c-a1a5-b9023fe9fd04'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:29 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] Created reservations ['c4df7b4a-0180-494c-b4ed-cb2b47f5c49b', '46e44319-87c1-4a1e-a095-f88130a8c52f', '27a1f9e4-b8df-458d-b63b-2a060d2353ef', 'fcc9ba28-eb19-4947-aaf7-3aa266e7a160'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:29 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-fe26fd56-7a64-4d2e-9c94-d95aac4aac55 tempest-GroupSnapshotsTest-689663665 None] group_snapshot f0e886d7-91a5-4391-a06e-2e9ed1cf1778: deleted successfully
Apr 15 16:29:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-74f61be8-6054-415f-902f-8c4b2b0d413f" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-74f61be8-6054-415f-902f-8c4b2b0d413f" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:31 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e15c4a4-d884-4450-8fa8-59e3a9e58aaa]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:31 devstack sudo[85351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f
Apr 15 16:29:31 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:31 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f" returned: 0 in 0.746s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:31 devstack sudo[85359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f
Apr 15 16:29:31 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:33 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-74f61be8-6054-415f-902f-8c4b2b0d413f" returned: 0 in 1.261s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-74f61be8-6054-415f-902f-8c4b2b0d413f" released by "delete_volume" :: held 2.100s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" acquired by "delete_volume" :: waited 0.087s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:33 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a14900-b999-4583-91a7-e2c28a6062d5]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:33 devstack sudo[85379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913
Apr 15 16:29:33 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:34 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" returned: 0 in 1.367s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:34 devstack sudo[85422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913
Apr 15 16:29:34 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:35 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" returned: 0 in 0.801s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-e2b1b7c6-7a02-42d1-b3c1-65ed63db2913" released by "delete_volume" :: held 2.286s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:35 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Created reservations ['fcb26ffc-2080-4dc9-9bb2-beaf978b3fb4'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:35 devstack cinder-volume[82156]: WARNING cinder.quota [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1431396558 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1431396558, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:29:35 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Created reservations ['1be55759-78d3-4258-a85d-bb4bef19ce7f', '1b260ebd-eb15-4bea-8e6d-90be9c99516d', '5fd02bd9-531c-4dcd-954c-eac3c53d58fe', 'a453c9a0-8c64-4f13-89ca-80bdb64795af'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:35 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Created reservations ['f091cc12-a29e-48a7-9ee7-a39e22fd3cf1', 'c084a4f7-3950-45c8-bcf7-71dc5d23771b', '63e2b806-32ef-4a26-9373-ebedb9170b10', 'f5d5bacc-fd3c-41ac-8ec7-5b3b3a00eee9'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:36 devstack sudo[85439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:29:36 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:36 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.760s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:36 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:29:36 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ff3ce790-0340-413b-9e3b-1a1f540a325e tempest-GroupSnapshotsTest-689663665 None] Delete group completed successfully.
Apr 15 16:29:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7a7998d9-84b6-43ee-8ad5-be910112a9ea tempest-GroupSnapshotsTest-689663665 None] Group tempest-GroupSnapshotsTest-Group-533234780: creating
Apr 15 16:29:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7a7998d9-84b6-43ee-8ad5-be910112a9ea tempest-GroupSnapshotsTest-689663665 None] Group tempest-GroupSnapshotsTest-Group-533234780: created successfully
Apr 15 16:29:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7a7998d9-84b6-43ee-8ad5-be910112a9ea tempest-GroupSnapshotsTest-689663665 None] Create group completed successfully.
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Flow 'volume_create_manager' (fdf22262-12c1-4ec1-a2aa-ecbd5172465b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3187c876-34e7-4800-b715-abe17f956035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3187c876-34e7-4800-b715-abe17f956035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392919907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce9ac011-2c53-460c-a98e-9751fc1c38b1,host='devstack@QuobyteHD#QuobyteHD',id=cbdb4d40-30e7-4f0f-a3b8-6e14a967d137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da6d0f9a3b347989a373fbc929da826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:39Z,use_quota=True,user_id='6af1750fd1c748fe84ee1112f7a32c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7f336a8-2528-4403-a52a-88e51701b3b4),volume_type_id=f7f336a8-2528-4403-a52a-88e51701b3b4)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9df1fc-8a7c-49a2-b4b0-96b15d7e242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9df1fc-8a7c-49a2-b4b0-96b15d7e242c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db04af77-7750-465a-b20c-de929dac01a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db04af77-7750-465a-b20c-de929dac01a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbdb4d40-30e7-4f0f-a3b8-6e14a967d137', 'volume_name': 'volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625c55d4-675b-4e9c-8733-0c79a77f4738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625c55d4-675b-4e9c-8733-0c79a77f4738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e644d790-5fe5-4370-b90a-b097937f8887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:38 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Volume cbdb4d40-30e7-4f0f-a3b8-6e14a967d137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137', 'volume_size': 1}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ce9ac011-2c53-460c-a98e-9751fc1c38b1,created_at=2026-04-15T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392919907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce9ac011-2c53-460c-a98e-9751fc1c38b1,host='devstack@QuobyteHD#QuobyteHD',id=cbdb4d40-30e7-4f0f-a3b8-6e14a967d137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da6d0f9a3b347989a373fbc929da826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:39Z,use_quota=True,user_id='6af1750fd1c748fe84ee1112f7a32c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7f336a8-2528-4403-a52a-88e51701b3b4),volume_type_id=f7f336a8-2528-4403-a52a-88e51701b3b4)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Creating volume cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:29:38 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:29:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:38 devstack sudo[85449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 1073741824
Apr 15 16:29:38 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:39 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 1073741824" returned: 0 in 0.589s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:39 devstack sudo[85454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137
Apr 15 16:29:39 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:40 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" returned: 0 in 0.714s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:29:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e644d790-5fe5-4370-b90a-b097937f8887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3728ae63-7cd5-40ca-99e0-055ecd78f198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Volume volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 (cbdb4d40-30e7-4f0f-a3b8-6e14a967d137): created successfully
Apr 15 16:29:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3728ae63-7cd5-40ca-99e0-055ecd78f198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Flow 'volume_create_manager' (fdf22262-12c1-4ec1-a2aa-ecbd5172465b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:40 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b68fe1af-d7ef-49e1-8b5a-20f29b9c492e tempest-GroupSnapshotsTest-689663665 None] Created volume successfully.
Apr 15 16:29:41 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] GroupSnapshot 5ab2943a-292a-40be-8f5b-ebf2c5b8188a: creating.
Apr 15 16:29:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Group snapshot 5ab2943a-292a-40be-8f5b-ebf2c5b8188a: creating. {{(pid=82156) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 16:29:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Creating offline snapshot 1a6d8979-a847-4940-84bd-30a4782e65fb of volume cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:29:41 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd603ea-0342-42e3-8e0b-fa38a021fbcf]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:41 devstack sudo[85534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137
Apr 15 16:29:41 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:42 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" returned: 0 in 1.453s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:42 devstack sudo[85580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb 1G
Apr 15 16:29:42 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:43 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb 1G" returned: 0 in 0.800s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:43 devstack sudo[85608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb
Apr 15 16:29:43 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (0737b133-5ea2-4494-be08-e1e2c90b7bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0781baa6-ea2d-4d60-90eb-1a09baa557e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0781baa6-ea2d-4d60-90eb-1a09baa557e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-590647964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:44Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b208917b-bb66-40fd-982d-675ee5996a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b208917b-bb66-40fd-982d-675ee5996a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58183cba-5e50-437e-825a-93358c10b5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58183cba-5e50-437e-825a-93358c10b5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410', 'volume_name': 'volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c41d38e-82d9-4939-8c74-8f5723743d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c41d38e-82d9-4939-8c74-8f5723743d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d562e748-9a1e-4035-b6ad-c9c60eb06cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:43 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Volume c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410', 'volume_size': 1}
Apr 15 16:29:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:44 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb" returned: 0 in 0.607s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:44 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:29:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:44 devstack sudo[85613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb
Apr 15 16:29:44 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:44 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb" returned: 0 in 0.481s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:45 devstack sudo[85619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.info
Apr 15 16:29:45 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:45 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.info" returned: 0 in 0.602s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:45 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:29:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:45 devstack sudo[85627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.info
Apr 15 16:29:45 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:46 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.info" returned: 0 in 0.539s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.902s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.392s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-590647964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:44Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Creating volume c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:29:46 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:46 devstack sudo[85630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 1073741824
Apr 15 16:29:46 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:46 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 1073741824" returned: 0 in 0.585s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:49 devstack sudo[85640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410
Apr 15 16:29:49 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:49 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b2adf423-02ef-4981-bf9e-9fe8aedb8785 tempest-GroupSnapshotsTest-689663665 None] group_snapshot 5ab2943a-292a-40be-8f5b-ebf2c5b8188a: created successfully
Apr 15 16:29:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:29:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:49 devstack sudo[85644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:29:49 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:50 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] group_snapshot 5ab2943a-292a-40be-8f5b-ebf2c5b8188a: deleting
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] group_snapshot 5ab2943a-292a-40be-8f5b-ebf2c5b8188a: deleting {{(pid=82156) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-1a6d8979-a847-4940-84bd-30a4782e65fb" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-1a6d8979-a847-4940-84bd-30a4782e65fb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Deleting offline snapshot 1a6d8979-a847-4940-84bd-30a4782e65fb of volume cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] snapshot_file for this snap is: volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e82142-63dd-4a92-9c9d-a2f11f019b2a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:50 devstack sudo[85647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb
Apr 15 16:29:50 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:50 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410" returned: 0 in 1.114s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] <== create_volume: return (4313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.316s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d562e748-9a1e-4035-b6ad-c9c60eb06cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074270e8-43dc-4ee4-9418-d06d503f802a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:50 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Volume volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 (c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410): created successfully
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074270e8-43dc-4ee4-9418-d06d503f802a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (0737b133-5ea2-4494-be08-e1e2c90b7bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:50 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e352faa7-e2a8-4d00-8765-ab8816770fee tempest-VolumesActionsTest-604360606 None] Created volume successfully.
Apr 15 16:29:50 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 1.031s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:29:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c30a983d-f004-4b9e-bc7f-f9acd1572935 tempest-VolumesActionsTest-604360606 None] Acquiring lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410" by "attach_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c30a983d-f004-4b9e-bc7f-f9acd1572935 tempest-VolumesActionsTest-604360606 None] Lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410" acquired by "attach_volume" :: waited 0.041s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c30a983d-f004-4b9e-bc7f-f9acd1572935 tempest-VolumesActionsTest-604360606 None] Attaching volume c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 to instance bbe49258-53a5-4f6f-98aa-adb566264b5e at mountpoint /dev/vdb on host None.
Apr 15 16:29:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c30a983d-f004-4b9e-bc7f-f9acd1572935 tempest-VolumesActionsTest-604360606 None] Attach volume completed successfully.
Apr 15 16:29:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c30a983d-f004-4b9e-bc7f-f9acd1572935 tempest-VolumesActionsTest-604360606 None] Lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410" released by "attach_volume" :: held 0.347s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:51 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb" returned: 0 in 1.269s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:29:51 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba1386c-1906-4ebd-8468-e4c7ddc0bf20]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:51 devstack sudo[85736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137
Apr 15 16:29:51 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-88084263-7da9-4682-81ee-8be19975de80 tempest-VolumesActionsTest-282724779 None] Terminate volume connection completed successfully.
Apr 15 16:29:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-88084263-7da9-4682-81ee-8be19975de80 tempest-VolumesActionsTest-282724779 None] Acquiring lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410-detach_volume" by "detach_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-88084263-7da9-4682-81ee-8be19975de80 tempest-VolumesActionsTest-282724779 None] Lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-88084263-7da9-4682-81ee-8be19975de80 tempest-VolumesActionsTest-282724779 None] Detaching volume c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 from instance bbe49258-53a5-4f6f-98aa-adb566264b5e.
Apr 15 16:29:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-88084263-7da9-4682-81ee-8be19975de80 tempest-VolumesActionsTest-282724779 None] Detach volume completed successfully.
Apr 15 16:29:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-88084263-7da9-4682-81ee-8be19975de80 tempest-VolumesActionsTest-282724779 None] Lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:53 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" returned: 0 in 1.381s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:53 devstack sudo[85747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb
Apr 15 16:29:53 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-de49b883-1746-4864-83b4-4249cc454763 tempest-VolumesActionsTest-604360606 None] Acquiring lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410-detach_volume" by "detach_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-de49b883-1746-4864-83b4-4249cc454763 tempest-VolumesActionsTest-604360606 None] Lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:53 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-de49b883-1746-4864-83b4-4249cc454763 tempest-VolumesActionsTest-604360606 None] Volume detach called, but volume not attached.
Apr 15 16:29:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-de49b883-1746-4864-83b4-4249cc454763 tempest-VolumesActionsTest-604360606 None] Lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:53 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb" returned: 0 in 0.901s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:53 devstack sudo[85754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb
Apr 15 16:29:53 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Acquiring lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Acquiring lock "cinder-quobyte-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Lock "cinder-quobyte-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410" acquired by "delete_volume" :: waited 0.016s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:54 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5698b6-1b43-4bae-b5c0-e9919c9fac51]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:54 devstack sudo[85756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410
Apr 15 16:29:54 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:54 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137.1a6d8979-a847-4940-84bd-30a4782e65fb" returned: 0 in 0.848s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-1a6d8979-a847-4940-84bd-30a4782e65fb" released by "_delete_snapshot" :: held 4.589s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" released by "delete_snapshot" :: held 4.620s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:54 devstack cinder-volume[82156]: WARNING cinder.quota [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1439899566 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1439899566, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:29:54 devstack cinder-volume[82156]: WARNING cinder.quota [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1439899566 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1439899566, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:29:55 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] Created reservations ['34d09506-5bd4-4b98-ad7d-5e0b2cb38fa0', 'cb8d8b3d-9d91-4357-bce4-2bb4ff8a1d7c', '79e83783-ccf5-4a77-9672-e453af2964ea', '0fd381c3-78c5-4128-b85d-e20791a070ee'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:55 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7b8af1d8-2923-494b-aaf2-2ac99700991f tempest-GroupSnapshotsTest-689663665 None] group_snapshot 5ab2943a-292a-40be-8f5b-ebf2c5b8188a: deleted successfully
Apr 15 16:29:55 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410" returned: 0 in 0.763s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:55 devstack sudo[85762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410
Apr 15 16:29:55 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "cinder-quobyte-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" acquired by "delete_volume" :: waited 0.033s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:29:56 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410" returned: 0 in 1.034s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ca1019-2cc6-4c4c-aaf9-a0332201f311]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Lock "cinder-quobyte-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410" released by "delete_volume" :: held 1.911s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Created reservations ['098aea69-3822-4242-9216-b001860e2dc6', 'dea9d856-9b14-437f-bf0c-365c233505f8', 'b7342db4-8732-48e9-ab8b-42f12b01af02', '7d93f0f0-db7e-4dc8-867c-37ed77387e73'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:56 devstack sudo[85765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137
Apr 15 16:29:56 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:56 devstack sudo[85767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:29:56 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:57 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.925s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:57 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:29:57 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Deleted volume successfully.
Apr 15 16:29:57 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20c17bd2-7251-41fa-8fa5-8b0d8b5cf185 tempest-VolumesActionsTest-604360606 None] Lock "cinder-c7f2c72a-68ac-4e4a-b5ac-5c1ad3a3a410-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:57 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" returned: 0 in 1.346s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:57 devstack sudo[85798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137
Apr 15 16:29:57 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Flow 'volume_create_manager' (28c7a2cd-ca44-475b-ac4b-2f463b06ea0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abae5131-9f53-47ae-b194-46c888d2d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abae5131-9f53-47ae-b194-46c888d2d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-14688659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea88ff2b-8896-4492-a944-be6d808414eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0b0c00d4934acda448a1ad8eb8b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:58Z,use_quota=True,user_id='d85ed39cf9494ce08d5efaf4a5d1ec24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf92d479-8d00-45f6-9886-d456a671aa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf92d479-8d00-45f6-9886-d456a671aa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdc191a-9029-45c2-a9f9-45013d1a4031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdc191a-9029-45c2-a9f9-45013d1a4031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea88ff2b-8896-4492-a944-be6d808414eb', 'volume_name': 'volume-ea88ff2b-8896-4492-a944-be6d808414eb', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2ee6cd-7142-46c2-8b53-b1b4fe92dab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2ee6cd-7142-46c2-8b53-b1b4fe92dab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92bf91c2-49d9-4bb3-aeda-002426a1b929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:29:58 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Volume ea88ff2b-8896-4492-a944-be6d808414eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea88ff2b-8896-4492-a944-be6d808414eb', 'volume_size': 1}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-14688659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea88ff2b-8896-4492-a944-be6d808414eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0b0c00d4934acda448a1ad8eb8b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:29:58Z,use_quota=True,user_id='d85ed39cf9494ce08d5efaf4a5d1ec24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Creating volume ea88ff2b-8896-4492-a944-be6d808414eb {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:29:58 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:58 devstack sudo[85821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb 1073741824
Apr 15 16:29:58 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:58 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" returned: 0 in 1.051s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Lock "cinder-quobyte-cbdb4d40-30e7-4f0f-a3b8-6e14a967d137" released by "delete_volume" :: held 2.605s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:29:58 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Created reservations ['0efb3f7b-5790-428f-a688-64fded93dc92'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:58 devstack cinder-volume[82156]: WARNING cinder.quota [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1439899566 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1439899566, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:29:59 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Created reservations ['bdb7361d-7ee5-46fb-b86b-09d2635a49cf', '60348f0a-dbdc-48c9-831b-56b777967583', '7bc1c745-3c4c-4bd7-929f-36be48d662bd', 'aaa692db-2deb-49a5-abfb-f8c5dd1bac95'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:29:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:29:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:29:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:29:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:29:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:29:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:59 devstack sudo[85854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:29:59 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:29:59 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root
Apr 15 16:29:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb 1073741824" returned: 0 in 1.389s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:29:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:29:59 devstack sudo[85858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb
Apr 15 16:29:59 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:00 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb" returned: 0 in 1.148s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] <== create_volume: return (2704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.706s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:01 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=115,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=2 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:30:01 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92bf91c2-49d9-4bb3-aeda-002426a1b929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea88ff2b-8896-4492-a944-be6d808414eb', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1fb7be-f379-4e72-b20f-6270b926b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:01 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=122,cinder:INSERT=32,cinder:UPDATE=104,cinder:DELETE=4 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:30:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 1.846s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:01 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:01 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Volume volume-ea88ff2b-8896-4492-a944-be6d808414eb (ea88ff2b-8896-4492-a944-be6d808414eb): created successfully
Apr 15 16:30:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1fb7be-f379-4e72-b20f-6270b926b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Flow 'volume_create_manager' (28c7a2cd-ca44-475b-ac4b-2f463b06ea0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:01 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-01799f48-c823-48bf-9522-e896ac87c9e3 tempest-GroupSnapshotsTest-689663665 None] Delete group completed successfully.
Apr 15 16:30:01 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-60c457ff-69fa-4486-ba28-4ea6733c3e3a tempest-ServersNegativeTestJSON-1948866792 None] Created volume successfully.
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Flow 'volume_create_manager' (06b3f466-e36c-43e8-8cbe-6822ad5b3626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b816d2-9f64-4b70-8e94-eb1274902a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b816d2-9f64-4b70-8e94-eb1274902a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-758235118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d149a462-0865-46fe-b874-fe36906cb7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0b0c00d4934acda448a1ad8eb8b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:03Z,use_quota=True,user_id='d85ed39cf9494ce08d5efaf4a5d1ec24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10746ddd-314b-4261-bcb3-df7fc0b015ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10746ddd-314b-4261-bcb3-df7fc0b015ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc207a5-821c-41ce-b34a-5c84e0c21fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc207a5-821c-41ce-b34a-5c84e0c21fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd149a462-0865-46fe-b874-fe36906cb7d6', 'volume_name': 'volume-d149a462-0865-46fe-b874-fe36906cb7d6', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f64ddc3-af69-4b93-b075-c12dd8d35ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f64ddc3-af69-4b93-b075-c12dd8d35ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd030c4-a4bd-44db-99ab-ae170fc311a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:03 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Volume d149a462-0865-46fe-b874-fe36906cb7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d149a462-0865-46fe-b874-fe36906cb7d6', 'volume_size': 1}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-758235118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d149a462-0865-46fe-b874-fe36906cb7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0b0c00d4934acda448a1ad8eb8b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:03Z,use_quota=True,user_id='d85ed39cf9494ce08d5efaf4a5d1ec24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Creating volume d149a462-0865-46fe-b874-fe36906cb7d6 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:03 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:03 devstack sudo[85894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6 1073741824
Apr 15 16:30:03 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:04 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6 1073741824" returned: 0 in 0.682s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:04 devstack sudo[85901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6
Apr 15 16:30:04 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:04 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6" returned: 0 in 0.502s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd030c4-a4bd-44db-99ab-ae170fc311a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d149a462-0865-46fe-b874-fe36906cb7d6', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de91af7-01b6-4965-9997-5e0eab92c2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:04 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Volume volume-d149a462-0865-46fe-b874-fe36906cb7d6 (d149a462-0865-46fe-b874-fe36906cb7d6): created successfully
Apr 15 16:30:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de91af7-01b6-4965-9997-5e0eab92c2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Flow 'volume_create_manager' (06b3f466-e36c-43e8-8cbe-6822ad5b3626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:04 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-961d17aa-7e47-44c5-9d93-739198e6ea61 tempest-ServersNegativeTestJSON-1948866792 None] Created volume successfully.
Apr 15 16:30:05 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-10e9f434-00b3-4ada-855e-14132af5058a req-fc59336a-d35d-4cb3-9ad2-3608011f6f6e tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Terminate volume connection completed successfully.
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-10e9f434-00b3-4ada-855e-14132af5058a req-fc59336a-d35d-4cb3-9ad2-3608011f6f6e tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Deleting attachment 3b8e9e84-8022-4e3d-b0dc-9fec4fa0a56e. {{(pid=82156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "cinder-d149a462-0865-46fe-b874-fe36906cb7d6-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Lock "cinder-d149a462-0865-46fe-b874-fe36906cb7d6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "cinder-quobyte-d149a462-0865-46fe-b874-fe36906cb7d6" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "cinder-1a8d48b7-cd9a-423d-acf4-b68428d002f7-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Lock "cinder-quobyte-d149a462-0865-46fe-b874-fe36906cb7d6" acquired by "delete_volume" :: waited 0.063s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "cinder-1a8d48b7-cd9a-423d-acf4-b68428d002f7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7785c80-7145-4fa8-a29c-3657561b73a7]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "cinder-quobyte-1a8d48b7-cd9a-423d-acf4-b68428d002f7" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "cinder-quobyte-1a8d48b7-cd9a-423d-acf4-b68428d002f7" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec2b9df-847a-4c99-a962-237bcb46737b]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:06 devstack sudo[85906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6
Apr 15 16:30:06 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:06 devstack sudo[85907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7
Apr 15 16:30:06 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (8dfaa99e-9450-4b9e-a8d3-7aba50720b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc9ef2f-a50d-4e16-aad0-9b2296f09b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc9ef2f-a50d-4e16-aad0-9b2296f09b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1609601051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692fa74e-aed8-424e-8f49-e35b61bacc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:06Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e149b1df-bb95-4ea5-b78d-6c69d0985328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e149b1df-bb95-4ea5-b78d-6c69d0985328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f4a8e2-bd38-4c06-a98b-365406979c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f4a8e2-bd38-4c06-a98b-365406979c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '692fa74e-aed8-424e-8f49-e35b61bacc14', 'volume_name': 'volume-692fa74e-aed8-424e-8f49-e35b61bacc14', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4364294-0bdb-4601-8644-740bdbe2f3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4364294-0bdb-4601-8644-740bdbe2f3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0766a5f-60cb-4662-9db7-79e0159616e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:06 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Volume 692fa74e-aed8-424e-8f49-e35b61bacc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-692fa74e-aed8-424e-8f49-e35b61bacc14', 'volume_size': 1}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1609601051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692fa74e-aed8-424e-8f49-e35b61bacc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:06Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Creating volume 692fa74e-aed8-424e-8f49-e35b61bacc14 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:06 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:06 devstack sudo[85910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14 1073741824
Apr 15 16:30:06 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:06 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6" returned: 0 in 0.722s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:06 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:06 devstack sudo[85917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6
Apr 15 16:30:06 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7" returned: 0 in 0.649s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:06 devstack sudo[85919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7
Apr 15 16:30:06 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:07 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14 1073741824" returned: 0 in 0.875s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:07 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7" returned: 1 in 0.522s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:07 devstack sudo[85928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14
Apr 15 16:30:07 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:07 devstack sudo[85929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7
Apr 15 16:30:07 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:07 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d149a462-0865-46fe-b874-fe36906cb7d6" returned: 0 in 0.610s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Lock "cinder-quobyte-d149a462-0865-46fe-b874-fe36906cb7d6" released by "delete_volume" :: held 1.367s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Created reservations ['24f6d638-a7bd-44b8-9958-5bdf3f45058a', '6c981336-755a-4ea5-86ae-4e120eddd1d5', 'd4990a69-11c1-460f-b95c-9f489f801a44', 'ea9a2938-0bd8-42b0-9e24-af0081833681'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:07 devstack sudo[85932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:07 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:07 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14" returned: 0 in 0.465s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0766a5f-60cb-4662-9db7-79e0159616e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-692fa74e-aed8-424e-8f49-e35b61bacc14', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b2da9a-7c40-4561-9b2b-7df3fa223805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:07 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Volume volume-692fa74e-aed8-424e-8f49-e35b61bacc14 (692fa74e-aed8-424e-8f49-e35b61bacc14): created successfully
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b2da9a-7c40-4561-9b2b-7df3fa223805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (8dfaa99e-9450-4b9e-a8d3-7aba50720b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:07 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5c5f3b38-4b5a-4c84-acca-a9f985f498c0 tempest-VolumesActionsTest-604360606 None] Created volume successfully.
Apr 15 16:30:07 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a8d48b7-cd9a-423d-acf4-b68428d002f7" returned: 0 in 0.582s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "cinder-quobyte-1a8d48b7-cd9a-423d-acf4-b68428d002f7" released by "delete_volume" :: held 1.807s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.quota [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Created reservations ['b454dfcc-4314-470e-8ff7-0615edb4b8e2', 'e01a276f-4ca9-4af7-879b-91c21d44e7f4', 'f480841c-a2c7-4bdc-a043-158bb7dca2c7', '43e674da-37f4-4d51-abc4-cbc50f594a82'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:07 devstack sudo[85938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:07 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:07 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.607s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "cinder-ea88ff2b-8896-4492-a944-be6d808414eb-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:07 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Deleted volume successfully.
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Lock "cinder-ea88ff2b-8896-4492-a944-be6d808414eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6070fa0a-8304-4f0d-917b-f2879b2d515e tempest-ServersNegativeTestJSON-1948866792 None] Lock "cinder-d149a462-0865-46fe-b874-fe36906cb7d6-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "cinder-quobyte-ea88ff2b-8896-4492-a944-be6d808414eb" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Lock "cinder-quobyte-ea88ff2b-8896-4492-a944-be6d808414eb" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07ede66-858d-4203-99c3-5ace6f4edf8a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:08 devstack sudo[85940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb
Apr 15 16:30:08 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:08 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.526s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG cinder.manager [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:08 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Deleted volume successfully.
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-10e9f434-00b3-4ada-855e-14132af5058a req-f0306db2-cd9a-4a67-96b0-0f9b603bf11b tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "cinder-1a8d48b7-cd9a-423d-acf4-b68428d002f7-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Acquiring lock "cinder-692fa74e-aed8-424e-8f49-e35b61bacc14-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Lock "cinder-692fa74e-aed8-424e-8f49-e35b61bacc14-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Acquiring lock "cinder-quobyte-692fa74e-aed8-424e-8f49-e35b61bacc14" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Lock "cinder-quobyte-692fa74e-aed8-424e-8f49-e35b61bacc14" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ccf058-1d4b-4b4b-bb76-d3df1e56d582]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:08 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5d0b7244-9d2a-4fcd-9454-44a82e627092 tempest-GroupsTest-1874373732 None] Group tempest-Group1-948862774: creating
Apr 15 16:30:08 devstack sudo[85943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14
Apr 15 16:30:08 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:08 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5d0b7244-9d2a-4fcd-9454-44a82e627092 tempest-GroupsTest-1874373732 None] Group tempest-Group1-948862774: created successfully
Apr 15 16:30:08 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5d0b7244-9d2a-4fcd-9454-44a82e627092 tempest-GroupsTest-1874373732 None] Create group completed successfully.
Apr 15 16:30:08 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb" returned: 0 in 0.670s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:08 devstack sudo[85948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb
Apr 15 16:30:08 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:09 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14" returned: 0 in 0.560s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:09 devstack sudo[85953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14
Apr 15 16:30:09 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:09 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea88ff2b-8896-4492-a944-be6d808414eb" returned: 0 in 0.517s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Lock "cinder-quobyte-ea88ff2b-8896-4492-a944-be6d808414eb" released by "delete_volume" :: held 1.218s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Created reservations ['562839c5-4733-4b7e-911f-d37ef68fd371', 'fd7c17f4-5e31-4d72-9b93-525be9e964fb', '5f658096-5bb3-4ad5-80a1-fc603ef4cdaa', '0a5a6741-f6b1-4ed4-a017-eb72cce7a045'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:09 devstack sudo[85957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:09 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:09 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-692fa74e-aed8-424e-8f49-e35b61bacc14" returned: 0 in 0.569s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Lock "cinder-quobyte-692fa74e-aed8-424e-8f49-e35b61bacc14" released by "delete_volume" :: held 1.160s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Created reservations ['26ed77ff-b5b7-4503-9bce-919a9d8a1034', '79c2450e-5199-4ddf-89cc-92dcbdc9765c', 'b5bf6810-349d-4887-9405-e4bca01976e8', '456f1c83-f1a7-4eeb-b44c-0b6010dc0b83'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:09 devstack sudo[85961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:09 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:09 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:09 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1c43b7a7-9395-4b55-b6d5-3dc498e1d9cd tempest-GroupsTest-1874373732 None] Group tempest-Group2-2130779162: creating
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:09 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Deleted volume successfully.
Apr 15 16:30:09 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1c43b7a7-9395-4b55-b6d5-3dc498e1d9cd tempest-GroupsTest-1874373732 None] Group tempest-Group2-2130779162: created successfully
Apr 15 16:30:09 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-074af1d2-dd7e-47c6-9880-7366b74c1c46 tempest-ServersNegativeTestJSON-1948866792 None] Lock "cinder-ea88ff2b-8896-4492-a944-be6d808414eb-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:09 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1c43b7a7-9395-4b55-b6d5-3dc498e1d9cd tempest-GroupsTest-1874373732 None] Create group completed successfully.
Apr 15 16:30:10 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.463s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:10 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:10 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Deleted volume successfully.
Apr 15 16:30:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-4613efa9-2802-4197-a473-9af25612c53b tempest-VolumesActionsTest-282724779 None] Lock "cinder-692fa74e-aed8-424e-8f49-e35b61bacc14-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (0d61b8a4-ebc6-4a4e-a4bb-a237e4bd9eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e3afbe-60cd-45dc-9fca-71469b05a568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e3afbe-60cd-45dc-9fca-71469b05a568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2063999253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1915ab-21b8-4dca-bee2-45b351dda24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:11Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd424fd-952d-48f7-8581-3b532127f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd424fd-952d-48f7-8581-3b532127f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3d0e79-eb35-4642-ac0f-a2af40900c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3d0e79-eb35-4642-ac0f-a2af40900c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1915ab-21b8-4dca-bee2-45b351dda24e', 'volume_name': 'volume-de1915ab-21b8-4dca-bee2-45b351dda24e', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bafbb5-4a7c-4cdd-9935-4dd213ba8d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bafbb5-4a7c-4cdd-9935-4dd213ba8d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcbeb6b-d587-4c2e-a5db-8c611dc5e3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Volume de1915ab-21b8-4dca-bee2-45b351dda24e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1915ab-21b8-4dca-bee2-45b351dda24e', 'volume_size': 1}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2063999253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1915ab-21b8-4dca-bee2-45b351dda24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:11Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Creating volume de1915ab-21b8-4dca-bee2-45b351dda24e {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:11 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:11 devstack sudo[86004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e 1073741824
Apr 15 16:30:11 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Flow 'volume_create_manager' (b95d08f8-05fe-4438-9b06-89c2c59aaad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1907a6-186a-4116-8692-fcb9f2302152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1907a6-186a-4116-8692-fcb9f2302152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1960285765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e748bb3-c3c0-4746-aa12-ef3366be733d,host='devstack@QuobyteHD#QuobyteHD',id=224c4169-9f6f-4ef3-bb2f-f384a86ce455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8f30eb0b2e4328a7274525ddf5d145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:11Z,use_quota=True,user_id='5506681983c8493590b36deb3fb50baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d292266-a36f-42b4-9875-a7f9911fba46),volume_type_id=6d292266-a36f-42b4-9875-a7f9911fba46)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8793a573-adce-44ca-acf4-f0fd03bd0b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8793a573-adce-44ca-acf4-f0fd03bd0b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e80d6d-a559-4077-98e8-0eb4959990b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e80d6d-a559-4077-98e8-0eb4959990b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224c4169-9f6f-4ef3-bb2f-f384a86ce455', 'volume_name': 'volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80c6e36-87a8-4f1e-9880-509d034401df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80c6e36-87a8-4f1e-9880-509d034401df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b114d-e5c1-4692-b27b-0d34cf7add78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:11 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Volume 224c4169-9f6f-4ef3-bb2f-f384a86ce455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455', 'volume_size': 1}
Apr 15 16:30:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:12 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e 1073741824" returned: 0 in 0.765s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:12 devstack sudo[86037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e
Apr 15 16:30:12 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:12 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e" returned: 0 in 0.476s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.030s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9e748bb3-c3c0-4746-aa12-ef3366be733d,created_at=2026-04-15T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1960285765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e748bb3-c3c0-4746-aa12-ef3366be733d,host='devstack@QuobyteHD#QuobyteHD',id=224c4169-9f6f-4ef3-bb2f-f384a86ce455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8f30eb0b2e4328a7274525ddf5d145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:11Z,use_quota=True,user_id='5506681983c8493590b36deb3fb50baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d292266-a36f-42b4-9875-a7f9911fba46),volume_type_id=6d292266-a36f-42b4-9875-a7f9911fba46)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Creating volume 224c4169-9f6f-4ef3-bb2f-f384a86ce455 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:12 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:12 devstack sudo[86041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455 1073741824
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcbeb6b-d587-4c2e-a5db-8c611dc5e3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1915ab-21b8-4dca-bee2-45b351dda24e', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:12 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4a037a-3c0b-4061-b7c8-40882b82ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:12 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Volume volume-de1915ab-21b8-4dca-bee2-45b351dda24e (de1915ab-21b8-4dca-bee2-45b351dda24e): created successfully
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4a037a-3c0b-4061-b7c8-40882b82ba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:12 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (0d61b8a4-ebc6-4a4e-a4bb-a237e4bd9eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:12 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-22215782-d9b1-4c8d-8de9-24d7e5fb09d3 tempest-VolumesActionsTest-604360606 None] Created volume successfully.
Apr 15 16:30:13 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455 1073741824" returned: 0 in 0.601s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:13 devstack sudo[86049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455
Apr 15 16:30:13 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Acquiring lock "cinder-de1915ab-21b8-4dca-bee2-45b351dda24e-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Lock "cinder-de1915ab-21b8-4dca-bee2-45b351dda24e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Acquiring lock "cinder-quobyte-de1915ab-21b8-4dca-bee2-45b351dda24e" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Lock "cinder-quobyte-de1915ab-21b8-4dca-bee2-45b351dda24e" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f45e996-b7e7-488e-8990-6012f9397cfd]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:13 devstack sudo[86051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e
Apr 15 16:30:13 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:13 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455" returned: 0 in 0.489s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b114d-e5c1-4692-b27b-0d34cf7add78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae91523-041d-4a98-b01e-0ff41aa0bff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:13 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Volume volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455 (224c4169-9f6f-4ef3-bb2f-f384a86ce455): created successfully
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae91523-041d-4a98-b01e-0ff41aa0bff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Flow 'volume_create_manager' (b95d08f8-05fe-4438-9b06-89c2c59aaad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:13 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-60487216-bc7b-428b-a757-e475eac19e0f tempest-GroupsTest-1874373732 None] Created volume successfully.
Apr 15 16:30:14 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e" returned: 0 in 0.525s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:14 devstack sudo[86057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e
Apr 15 16:30:14 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:14 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-de1915ab-21b8-4dca-bee2-45b351dda24e" returned: 0 in 0.432s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Lock "cinder-quobyte-de1915ab-21b8-4dca-bee2-45b351dda24e" released by "delete_volume" :: held 0.985s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Created reservations ['8c7d5442-3908-4f20-a9c8-74312c202732', '6972d80f-d65a-4c64-bb76-ce39dcc235c6', '3c4c0d69-14c1-44b7-89f7-c41c6218023d', 'b1f04ded-8e1d-449b-8d95-b07aff8ac74a'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:14 devstack sudo[86060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:14 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Acquiring lock "cinder-quobyte-224c4169-9f6f-4ef3-bb2f-f384a86ce455" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Lock "cinder-quobyte-224c4169-9f6f-4ef3-bb2f-f384a86ce455" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[911ab497-2399-48e1-86fd-a0af38c1b4e5]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:15 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.505s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Deleted volume successfully.
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bd47a20a-63c7-4501-aa65-63ee63d2a5f2 tempest-VolumesActionsTest-282724779 None] Lock "cinder-de1915ab-21b8-4dca-bee2-45b351dda24e-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:15 devstack sudo[86064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455
Apr 15 16:30:15 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:15 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455" returned: 0 in 0.506s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:15 devstack sudo[86069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455
Apr 15 16:30:15 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (bfbd9dfb-4469-46ff-86a8-efa246344873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a667a44c-578b-455e-9a6e-895ffb3e03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a667a44c-578b-455e-9a6e-895ffb3e03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173285962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8325483b-9d8f-4ab3-8ff1-8088e4d5547b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:16Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fd10a9-a6b9-4715-bfd0-f4c31a5fa6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fd10a9-a6b9-4715-bfd0-f4c31a5fa6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08eefea6-fd09-4729-a9e7-51a32f6ad198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08eefea6-fd09-4729-a9e7-51a32f6ad198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8325483b-9d8f-4ab3-8ff1-8088e4d5547b', 'volume_name': 'volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb86c911-def0-40d1-a341-3d05611cbbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb86c911-def0-40d1-a341-3d05611cbbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e73062-e58a-4064-b1fc-ac18e89d12f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:15 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Volume 8325483b-9d8f-4ab3-8ff1-8088e4d5547b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b', 'volume_size': 1}
Apr 15 16:30:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173285962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8325483b-9d8f-4ab3-8ff1-8088e4d5547b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:16Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Creating volume 8325483b-9d8f-4ab3-8ff1-8088e4d5547b {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:16 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:16 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-224c4169-9f6f-4ef3-bb2f-f384a86ce455" returned: 0 in 0.526s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Lock "cinder-quobyte-224c4169-9f6f-4ef3-bb2f-f384a86ce455" released by "delete_volume" :: held 1.072s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:16 devstack sudo[86073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b 1073741824
Apr 15 16:30:16 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Created reservations ['9bf8b5f9-6004-425c-83bd-8ad1969045c5'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:16 devstack cinder-volume[82156]: WARNING cinder.quota [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-15634999 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-15634999, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:30:16 devstack cinder-volume[82156]: WARNING cinder.quota [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-15634999 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-15634999, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Created reservations ['9b93848b-8a40-429c-947c-5d8556da3070', '104c0222-62ec-4bff-9cc6-52ba4da71276', 'a2a2079d-f9c3-4cbc-bf1d-8acd5899a909', 'bba912f3-30b8-400c-a9f7-a7b6ea58a613'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:16 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:16 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:16 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b 1073741824" returned: 0 in 0.557s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:16 devstack sudo[86081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b
Apr 15 16:30:16 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:16 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.478s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:16 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:16 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8f2e8787-54f6-4d59-8fc0-98888787d67a tempest-GroupsTest-1874373732 None] Delete group completed successfully.
Apr 15 16:30:17 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b" returned: 0 in 0.580s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e73062-e58a-4064-b1fc-ac18e89d12f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa9a76e-fea3-4696-9894-2e79ffdc52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:17 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Volume volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b (8325483b-9d8f-4ab3-8ff1-8088e4d5547b): created successfully
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa9a76e-fea3-4696-9894-2e79ffdc52c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (bfbd9dfb-4469-46ff-86a8-efa246344873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:17 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cc0d727f-f9fb-4e85-86c3-d32324ffdf48 tempest-VolumesActionsTest-604360606 None] Created volume successfully.
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] Created reservations ['76d4f26d-7166-47e3-a34d-c6836a460e96'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:17 devstack sudo[86107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:17 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:17 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.487s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:17 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:17 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7af82b1c-da00-4e94-bb1a-8092d6e8641a tempest-GroupsTest-1874373732 None] Delete group completed successfully.
Apr 15 16:30:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Acquiring lock "cinder-8325483b-9d8f-4ab3-8ff1-8088e4d5547b-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Lock "cinder-8325483b-9d8f-4ab3-8ff1-8088e4d5547b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Acquiring lock "cinder-quobyte-8325483b-9d8f-4ab3-8ff1-8088e4d5547b" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Lock "cinder-quobyte-8325483b-9d8f-4ab3-8ff1-8088e4d5547b" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:18 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6f8ee1-0e64-42aa-a4b5-7a136a9bdf5b]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:18 devstack sudo[86115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b
Apr 15 16:30:18 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:18 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9082befd-20b2-4556-8ce4-89c2fe1d55a3 tempest-GroupsTest-1874373732 None] Group tempest-GroupsTest-Group-1228073759: creating
Apr 15 16:30:18 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9082befd-20b2-4556-8ce4-89c2fe1d55a3 tempest-GroupsTest-1874373732 None] Group tempest-GroupsTest-Group-1228073759: created successfully
Apr 15 16:30:18 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9082befd-20b2-4556-8ce4-89c2fe1d55a3 tempest-GroupsTest-1874373732 None] Create group completed successfully.
Apr 15 16:30:18 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b" returned: 0 in 0.659s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:18 devstack sudo[86123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b
Apr 15 16:30:18 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:19 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8325483b-9d8f-4ab3-8ff1-8088e4d5547b" returned: 0 in 0.458s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Lock "cinder-quobyte-8325483b-9d8f-4ab3-8ff1-8088e4d5547b" released by "delete_volume" :: held 1.151s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Created reservations ['de5b7ae1-c0c9-4b4f-8f80-0d12524460c3', 'd010a5eb-9662-44ee-afc6-bed2aa041bdc', '605e436e-25f5-45d8-9097-65c327b18233', '15a92ead-824f-41ec-a2aa-d0aa4f153315'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:19 devstack sudo[86126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:19 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:19 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-3bf447af-f42b-4371-89f9-3f58dfc00111 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Terminate volume connection completed successfully.
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-3bf447af-f42b-4371-89f9-3f58dfc00111 tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Deleting attachment 9473589d-f41b-444b-b095-94877ba2a7ef. {{(pid=82156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 16:30:19 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.509s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:19 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Deleted volume successfully.
Apr 15 16:30:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d22b39c8-6723-412e-9ca5-e4f100549989 tempest-VolumesActionsTest-282724779 None] Lock "cinder-8325483b-9d8f-4ab3-8ff1-8088e4d5547b-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Flow 'volume_create_manager' (2f8feec7-0d66-422c-82c0-ca4ddce52e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f280ce93-f456-4127-a6a1-ffa32693b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f280ce93-f456-4127-a6a1-ffa32693b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808219329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=142d9cc7-cf41-4c89-87f0-469e726b3317,host='devstack@QuobyteHD#QuobyteHD',id=82a8b691-2979-42d5-8bb1-9624be18a281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8f30eb0b2e4328a7274525ddf5d145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:20Z,use_quota=True,user_id='5506681983c8493590b36deb3fb50baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(112cf98b-e16b-47fc-aa8f-9f8ddfed408f),volume_type_id=112cf98b-e16b-47fc-aa8f-9f8ddfed408f)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f04be3-56ba-4a19-8e18-0973a394ac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f04be3-56ba-4a19-8e18-0973a394ac33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37da0b48-1a74-4f28-86ab-c79a6fc07e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37da0b48-1a74-4f28-86ab-c79a6fc07e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a8b691-2979-42d5-8bb1-9624be18a281', 'volume_name': 'volume-82a8b691-2979-42d5-8bb1-9624be18a281', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d460e1a4-85e6-4f09-9779-e21d3ef5aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d460e1a4-85e6-4f09-9779-e21d3ef5aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffb7222-a932-4f94-9a65-17865d247780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Volume 82a8b691-2979-42d5-8bb1-9624be18a281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a8b691-2979-42d5-8bb1-9624be18a281', 'volume_size': 1}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=142d9cc7-cf41-4c89-87f0-469e726b3317,created_at=2026-04-15T14:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808219329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=142d9cc7-cf41-4c89-87f0-469e726b3317,host='devstack@QuobyteHD#QuobyteHD',id=82a8b691-2979-42d5-8bb1-9624be18a281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8f30eb0b2e4328a7274525ddf5d145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:20Z,use_quota=True,user_id='5506681983c8493590b36deb3fb50baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(112cf98b-e16b-47fc-aa8f-9f8ddfed408f),volume_type_id=112cf98b-e16b-47fc-aa8f-9f8ddfed408f)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Creating volume 82a8b691-2979-42d5-8bb1-9624be18a281 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:20 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "cinder-6c6fad04-677f-406c-9254-8fb6effd11ab-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "cinder-6c6fad04-677f-406c-9254-8fb6effd11ab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:20 devstack sudo[86130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281 1073741824
Apr 15 16:30:20 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "cinder-quobyte-6c6fad04-677f-406c-9254-8fb6effd11ab" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "cinder-quobyte-6c6fad04-677f-406c-9254-8fb6effd11ab" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcd4c8e-5c56-4905-9fe4-d08ef6eb09eb]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:20 devstack sudo[86132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab
Apr 15 16:30:20 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (62d07bb5-a5ac-45e7-bfdc-716aacd32281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7d9e18-4a9e-4499-825f-b1b4f2ad6f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7d9e18-4a9e-4499-825f-b1b4f2ad6f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-870084465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e1b4a7-c849-47dd-992c-75f28c35e331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:21Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe870b6-2b53-4018-9ceb-4da9d414ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe870b6-2b53-4018-9ceb-4da9d414ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447dba5a-38de-4ab5-b759-72e1171a414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447dba5a-38de-4ab5-b759-72e1171a414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e1b4a7-c849-47dd-992c-75f28c35e331', 'volume_name': 'volume-14e1b4a7-c849-47dd-992c-75f28c35e331', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32cdf95-aece-43af-9269-e415b3334da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32cdf95-aece-43af-9269-e415b3334da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31a6671-9491-4819-8eae-e8411a96169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:20 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Volume 14e1b4a7-c849-47dd-992c-75f28c35e331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e1b4a7-c849-47dd-992c-75f28c35e331', 'volume_size': 1}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:20 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281 1073741824" returned: 0 in 0.684s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:20 devstack sudo[86140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281
Apr 15 16:30:20 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:20 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab" returned: 0 in 0.699s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:20 devstack sudo[86142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab
Apr 15 16:30:20 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:21 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281" returned: 0 in 0.470s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-870084465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e1b4a7-c849-47dd-992c-75f28c35e331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:21Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Creating volume 14e1b4a7-c849-47dd-992c-75f28c35e331 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:21 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffb7222-a932-4f94-9a65-17865d247780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a8b691-2979-42d5-8bb1-9624be18a281', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c993e832-5414-4b46-8577-59c1581d4c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:21 devstack sudo[86146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331 1073741824
Apr 15 16:30:21 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:21 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Volume volume-82a8b691-2979-42d5-8bb1-9624be18a281 (82a8b691-2979-42d5-8bb1-9624be18a281): created successfully
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c993e832-5414-4b46-8577-59c1581d4c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Flow 'volume_create_manager' (2f8feec7-0d66-422c-82c0-ca4ddce52e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:21 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:21 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d6d45795-07a9-46cd-9be3-1306f0b34f8b tempest-GroupsTest-1874373732 None] Created volume successfully.
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6c6fad04-677f-406c-9254-8fb6effd11ab" returned: 0 in 0.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "cinder-quobyte-6c6fad04-677f-406c-9254-8fb6effd11ab" released by "delete_volume" :: held 1.199s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.quota [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Created reservations ['f5678174-e1d9-44a1-aaa6-e026963efc34', '641dbb74-e8a9-476c-880d-654bc7213fff', '770173b3-a9d3-41b6-833f-27fcb2cd7b5f', '74b2ddeb-cfde-4e27-abf3-9fb4c748a863'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:21 devstack sudo[86148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:21 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:21 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331 1073741824" returned: 0 in 0.552s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:21 devstack sudo[86154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331
Apr 15 16:30:21 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:22 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.532s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.manager [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Deleted volume successfully.
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-9487b4d0-ae82-4fdc-a283-69fee877bba3 req-9e251887-9040-429d-8054-d92b1525899a tempest-ServerBootFromVolumeStableRescueTest-2012510219 None] Lock "cinder-6c6fad04-677f-406c-9254-8fb6effd11ab-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Flow 'volume_create_manager' (2791f9bc-c83b-4bec-b1dd-2e422d4d0a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d7b875-421a-48c4-b274-f2f2783e903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d7b875-421a-48c4-b274-f2f2783e903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1479847960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013e460b-d148-4202-b74c-391beac73d67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d3175a825f024fb5b2bb475794eba58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:22Z,use_quota=True,user_id='dd009de0431e4fc7a65d481eee405668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82deb0d6-8b5a-4c79-bc50-8b603fbbe89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82deb0d6-8b5a-4c79-bc50-8b603fbbe89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8912ffe8-bdde-4e91-84f3-1c46d14915a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8912ffe8-bdde-4e91-84f3-1c46d14915a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '013e460b-d148-4202-b74c-391beac73d67', 'volume_name': 'volume-013e460b-d148-4202-b74c-391beac73d67', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9595c6dd-391f-40e4-9f96-f4e42f4b2343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9595c6dd-391f-40e4-9f96-f4e42f4b2343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cd6cac-b252-46ef-941f-3f147f4b5f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Volume 013e460b-d148-4202-b74c-391beac73d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-013e460b-d148-4202-b74c-391beac73d67', 'volume_size': 1}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:22 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331" returned: 0 in 0.504s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1479847960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013e460b-d148-4202-b74c-391beac73d67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d3175a825f024fb5b2bb475794eba58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:22Z,use_quota=True,user_id='dd009de0431e4fc7a65d481eee405668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Creating volume 013e460b-d148-4202-b74c-391beac73d67 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:22 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:22 devstack sudo[86157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67 1073741824
Apr 15 16:30:22 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31a6671-9491-4819-8eae-e8411a96169d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e1b4a7-c849-47dd-992c-75f28c35e331', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73330e25-e0b2-4866-adff-43e154f95926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Volume volume-14e1b4a7-c849-47dd-992c-75f28c35e331 (14e1b4a7-c849-47dd-992c-75f28c35e331): created successfully
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73330e25-e0b2-4866-adff-43e154f95926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (62d07bb5-a5ac-45e7-bfdc-716aacd32281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1f1c125f-d7dd-462c-a7ea-21449863968b tempest-VolumesActionsTest-604360606 None] Created volume successfully.
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Flow 'volume_create_manager' (c5bfcc04-ebb4-4ac9-a317-0273d13832ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08da3227-89d9-4805-97da-e010a1dcf423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08da3227-89d9-4805-97da-e010a1dcf423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1744313407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=142d9cc7-cf41-4c89-87f0-469e726b3317,host='devstack@QuobyteHD#QuobyteHD',id=0ea8a623-25da-46d5-aee1-aee6c0c2e998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8f30eb0b2e4328a7274525ddf5d145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:23Z,use_quota=True,user_id='5506681983c8493590b36deb3fb50baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(112cf98b-e16b-47fc-aa8f-9f8ddfed408f),volume_type_id=112cf98b-e16b-47fc-aa8f-9f8ddfed408f)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee98ca9-6a3c-4050-bf58-851b34849cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee98ca9-6a3c-4050-bf58-851b34849cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55a9c49-9774-4fef-9b05-4bde3a586cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55a9c49-9774-4fef-9b05-4bde3a586cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea8a623-25da-46d5-aee1-aee6c0c2e998', 'volume_name': 'volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e688861-c195-4c37-aa66-ed9809a99896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e688861-c195-4c37-aa66-ed9809a99896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2151d0f4-c436-4138-a018-f1b8b7fab218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:22 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Volume 0ea8a623-25da-46d5-aee1-aee6c0c2e998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998', 'volume_size': 1}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Acquiring lock "cinder-14e1b4a7-c849-47dd-992c-75f28c35e331-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Lock "cinder-14e1b4a7-c849-47dd-992c-75f28c35e331-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Acquiring lock "cinder-quobyte-14e1b4a7-c849-47dd-992c-75f28c35e331" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Lock "cinder-quobyte-14e1b4a7-c849-47dd-992c-75f28c35e331" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f91fe-3ef2-43b9-b91e-797812857ed3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:22 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67 1073741824" returned: 0 in 0.543s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:23 devstack sudo[86162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331
Apr 15 16:30:23 devstack sudo[86163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67
Apr 15 16:30:23 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:23 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:23 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331" returned: 0 in 0.539s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:23 devstack sudo[86171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331
Apr 15 16:30:23 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:23 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67" returned: 0 in 0.524s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=142d9cc7-cf41-4c89-87f0-469e726b3317,created_at=2026-04-15T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1744313407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=142d9cc7-cf41-4c89-87f0-469e726b3317,host='devstack@QuobyteHD#QuobyteHD',id=0ea8a623-25da-46d5-aee1-aee6c0c2e998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8f30eb0b2e4328a7274525ddf5d145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:23Z,use_quota=True,user_id='5506681983c8493590b36deb3fb50baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(112cf98b-e16b-47fc-aa8f-9f8ddfed408f),volume_type_id=112cf98b-e16b-47fc-aa8f-9f8ddfed408f)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Creating volume 0ea8a623-25da-46d5-aee1-aee6c0c2e998 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:23 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:23 devstack sudo[86173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998 1073741824
Apr 15 16:30:23 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cd6cac-b252-46ef-941f-3f147f4b5f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013e460b-d148-4202-b74c-391beac73d67', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688579e3-a620-4e49-9133-643371b4ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:23 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Volume volume-013e460b-d148-4202-b74c-391beac73d67 (013e460b-d148-4202-b74c-391beac73d67): created successfully
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688579e3-a620-4e49-9133-643371b4ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Flow 'volume_create_manager' (2791f9bc-c83b-4bec-b1dd-2e422d4d0a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:23 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-507ace6b-a809-45a2-b34f-421506c95e4b req-7acd5ce1-f1e2-4f9c-9d5a-279e8d057892 tempest-VolumesGetTestJSON-1652551998 None] Created volume successfully.
Apr 15 16:30:23 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-14e1b4a7-c849-47dd-992c-75f28c35e331" returned: 0 in 0.437s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Lock "cinder-quobyte-14e1b4a7-c849-47dd-992c-75f28c35e331" released by "delete_volume" :: held 1.007s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Created reservations ['f3b24013-cd86-4cdb-a666-0c159fde48db', 'c0998980-a40e-4e10-ac51-29b579843e06', 'd031b372-22d9-48d6-8a10-b269df33b2e2', '4031d617-5852-4fca-b1f4-23cb00de4c3c'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:24 devstack sudo[86180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:24 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:24 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998 1073741824" returned: 0 in 0.552s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:24 devstack sudo[86182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998
Apr 15 16:30:24 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Acquiring lock "cinder-013e460b-d148-4202-b74c-391beac73d67-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Lock "cinder-013e460b-d148-4202-b74c-391beac73d67-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:24 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998" returned: 0 in 0.505s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:24 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2151d0f4-c436-4138-a018-f1b8b7fab218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d966b6-6ee8-4685-bea0-cdb33e0dbb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.648s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:24 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Volume volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998 (0ea8a623-25da-46d5-aee1-aee6c0c2e998): created successfully
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d966b6-6ee8-4685-bea0-cdb33e0dbb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Flow 'volume_create_manager' (c5bfcc04-ebb4-4ac9-a317-0273d13832ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:24 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Deleted volume successfully.
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Acquiring lock "cinder-quobyte-013e460b-d148-4202-b74c-391beac73d67" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:24 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-85a47616-123f-4397-a6bb-7e0bef584a50 tempest-GroupsTest-1874373732 None] Created volume successfully.
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Lock "cinder-quobyte-013e460b-d148-4202-b74c-391beac73d67" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ee91475-0843-479f-ac2c-bf2db0f8f864 tempest-VolumesActionsTest-282724779 None] Lock "cinder-14e1b4a7-c849-47dd-992c-75f28c35e331-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d5d7b4-e5ae-4f15-b019-b1753ed926fa]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:24 devstack sudo[86212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67
Apr 15 16:30:24 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:25 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67" returned: 0 in 0.555s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:25 devstack sudo[86218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67
Apr 15 16:30:25 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (6826f1aa-1997-4312-908c-4a763a57165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61f34ba-01e9-4df8-bb29-1ef775e2bef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61f34ba-01e9-4df8-bb29-1ef775e2bef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1048133725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d238824-1517-45d5-bfdb-6f097337705e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:25Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa52105-48f5-401c-b675-a571fb49962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa52105-48f5-401c-b675-a571fb49962a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f0d5ab-f809-4fe7-8d90-af1818636596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f0d5ab-f809-4fe7-8d90-af1818636596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d238824-1517-45d5-bfdb-6f097337705e', 'volume_name': 'volume-6d238824-1517-45d5-bfdb-6f097337705e', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7842a82f-33f0-48b5-b81e-aa8f890b4710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7842a82f-33f0-48b5-b81e-aa8f890b4710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84a6609-5096-4888-b305-325d31d59eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:25 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Volume 6d238824-1517-45d5-bfdb-6f097337705e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d238824-1517-45d5-bfdb-6f097337705e', 'volume_size': 1}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1048133725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d238824-1517-45d5-bfdb-6f097337705e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec603d8f3984799948bc80fa4198b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:25Z,use_quota=True,user_id='42cc8188d4d747998cb9598ffb828737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Creating volume 6d238824-1517-45d5-bfdb-6f097337705e {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:25 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:25 devstack sudo[86220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e 1073741824
Apr 15 16:30:25 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:25 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-013e460b-d148-4202-b74c-391beac73d67" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Lock "cinder-quobyte-013e460b-d148-4202-b74c-391beac73d67" released by "delete_volume" :: held 1.047s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.quota [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Created reservations ['2ad00567-e82d-45fd-8b8a-cce9032081eb', 'cff96619-5f27-48f0-88f7-d2e78d33dc55', 'd29a4d43-1507-41af-be58-a3db1fb735b6', '67b3ac24-cd01-4517-886c-34f9969e082b'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:25 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:25 devstack sudo[86227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:25 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e 1073741824" returned: 0 in 0.557s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:26 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-dc09910c-0e4c-42b6-996e-0ead960b4d4e tempest-GroupsTest-1874373732 None] Update group completed successfully.
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:26 devstack sudo[86229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e
Apr 15 16:30:26 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:26 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.456s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG cinder.manager [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:26 devstack cinder-volume[82156]: INFO cinder.volume.manager [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Deleted volume successfully.
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG cinder.coordination [req-a8268157-9c07-48f3-a414-111a29c6bbae req-9e9ad4f8-1253-4b69-b65e-2be20ab2154e tempest-VolumesGetTestJSON-1652551998 None] Lock "cinder-013e460b-d148-4202-b74c-391beac73d67-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:26 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84a6609-5096-4888-b305-325d31d59eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d238824-1517-45d5-bfdb-6f097337705e', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee481cc-59dd-4373-b9d0-85b876278471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:26 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Volume volume-6d238824-1517-45d5-bfdb-6f097337705e (6d238824-1517-45d5-bfdb-6f097337705e): created successfully
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee481cc-59dd-4373-b9d0-85b876278471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Flow 'volume_create_manager' (6826f1aa-1997-4312-908c-4a763a57165d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:26 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-44f73c45-80a4-41e5-8ffb-12b1dbedc1ea tempest-VolumesActionsTest-604360606 None] Created volume successfully.
Apr 15 16:30:27 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-08be9f74-08bc-4fe3-a972-779123f8f4ff tempest-GroupsTest-1874373732 None] Update group completed successfully.
Apr 15 16:30:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Acquiring lock "cinder-6d238824-1517-45d5-bfdb-6f097337705e-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Lock "cinder-6d238824-1517-45d5-bfdb-6f097337705e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Acquiring lock "cinder-quobyte-6d238824-1517-45d5-bfdb-6f097337705e" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Lock "cinder-quobyte-6d238824-1517-45d5-bfdb-6f097337705e" acquired by "delete_volume" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6543ab20-09c8-43d5-ae93-10566af99688]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:28 devstack sudo[86235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e
Apr 15 16:30:28 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Acquiring lock "cinder-quobyte-0ea8a623-25da-46d5-aee1-aee6c0c2e998" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Lock "cinder-quobyte-0ea8a623-25da-46d5-aee1-aee6c0c2e998" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8e3497-6c8f-4b08-93a0-9d27408a1767]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:28 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e" returned: 0 in 0.580s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:28 devstack sudo[86241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e
Apr 15 16:30:28 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:28 devstack sudo[86240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998
Apr 15 16:30:28 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:29 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6d238824-1517-45d5-bfdb-6f097337705e" returned: 0 in 0.465s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Lock "cinder-quobyte-6d238824-1517-45d5-bfdb-6f097337705e" released by "delete_volume" :: held 1.073s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:29 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998" returned: 0 in 0.564s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Created reservations ['d5adb5a0-d171-4191-bc93-57ef85796f32', 'b42b1a7d-f2e5-4b93-9278-2e71195c8b97', 'f3613cb7-00ef-4843-b0d3-3f134c7aa71b', '4607beae-cae6-4150-8ba2-ffa58a18bfb5'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:29 devstack sudo[86254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998
Apr 15 16:30:29 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:29 devstack sudo[86256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:29 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:29 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-0ea8a623-25da-46d5-aee1-aee6c0c2e998" returned: 0 in 0.441s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Lock "cinder-quobyte-0ea8a623-25da-46d5-aee1-aee6c0c2e998" released by "delete_volume" :: held 1.030s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Acquiring lock "cinder-quobyte-82a8b691-2979-42d5-8bb1-9624be18a281" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Lock "cinder-quobyte-82a8b691-2979-42d5-8bb1-9624be18a281" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1e1851-4d17-4f54-b0b6-e3c271731165]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:29 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.481s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:29 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Deleted volume successfully.
Apr 15 16:30:29 devstack sudo[86260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281
Apr 15 16:30:29 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b0d8dbc-c769-44d0-b95e-f1fd473f3030 tempest-VolumesActionsTest-604360606 None] Lock "cinder-6d238824-1517-45d5-bfdb-6f097337705e-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-697616e6-8151-4b0d-9171-9b2abc086d12 tempest-BackendsCapabilitiesAdminTestsJSON-958568127 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7265281677246, 'free_capacity_gb': 1775.7265281677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82156) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 16:30:30 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281" returned: 0 in 0.535s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:30 devstack sudo[86265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281
Apr 15 16:30:30 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb04d2a0-2da7-4dc8-bb93-35fcfd93164b tempest-BackendsCapabilitiesAdminTestsJSON-958568127 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7265281677246, 'free_capacity_gb': 1775.7265281677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82156) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 16:30:30 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-82a8b691-2979-42d5-8bb1-9624be18a281" returned: 0 in 0.529s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Lock "cinder-quobyte-82a8b691-2979-42d5-8bb1-9624be18a281" released by "delete_volume" :: held 1.095s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Created reservations ['5131d69f-3c06-4c18-852e-1845b53c42ac'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:30 devstack cinder-volume[82156]: WARNING cinder.quota [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1935476287 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1935476287, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:30:30 devstack cinder-volume[82156]: WARNING cinder.quota [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1935476287 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1935476287, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Created reservations ['8448b377-8811-425d-8a53-05a3f1837338', 'a092cea9-987d-4a4b-a05c-17b35f5fa103', 'defdeeaf-2068-40ca-a1cc-e5905866d06d', 'c7c0adf0-9fe6-41db-bdd6-6637775e0dc7'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Created reservations ['68ac2b02-d14a-436f-941b-2390962d0b83', '7299d6bf-69b3-4de0-976a-e64afbbc887b', '2301952d-ab37-4a1e-b342-e39342c71584', '5e4b7de4-e895-4b91-b44e-22f7c635fc6d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:30 devstack sudo[86269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:30 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:31 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.576s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:31 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-98955c5f-7bb5-4e80-b084-648223d88722 tempest-GroupsTest-1874373732 None] Delete group completed successfully.
Apr 15 16:30:35 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-480bbb2f-a6f8-4737-a490-963d7a2308fa tempest-GroupSnapshotsV319Test-1742026067 None] Group tempest-GroupSnapshotsV319Test-Group-1285373010: creating
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Flow 'volume_create_manager' (5bb589a1-1c89-4a86-9322-8a9f8485994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffd8b77-69f3-42d2-975e-9f3b1f59558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:35 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-480bbb2f-a6f8-4737-a490-963d7a2308fa tempest-GroupSnapshotsV319Test-1742026067 None] Group tempest-GroupSnapshotsV319Test-Group-1285373010: created successfully
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffd8b77-69f3-42d2-975e-9f3b1f59558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-586478307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc12505-9103-479d-bd42-65af203eb638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d33b898d54e46198abd01d4a6fc8c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:36Z,use_quota=True,user_id='c098ee99c686456991ccad1d51c167a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7512da-6201-4b93-85e0-b12b4a7c2161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7512da-6201-4b93-85e0-b12b4a7c2161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c156fb0c-7514-41c5-b108-bd5624ea48c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c156fb0c-7514-41c5-b108-bd5624ea48c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc12505-9103-479d-bd42-65af203eb638', 'volume_name': 'volume-efc12505-9103-479d-bd42-65af203eb638', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2430879c-0aa7-4591-8267-8cfd295cfd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2430879c-0aa7-4591-8267-8cfd295cfd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf38fa1-6970-43b9-b017-92e45d85c7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:35 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Volume efc12505-9103-479d-bd42-65af203eb638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc12505-9103-479d-bd42-65af203eb638', 'volume_size': 1}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-586478307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc12505-9103-479d-bd42-65af203eb638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d33b898d54e46198abd01d4a6fc8c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:36Z,use_quota=True,user_id='c098ee99c686456991ccad1d51c167a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Creating volume efc12505-9103-479d-bd42-65af203eb638 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:35 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:35 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-480bbb2f-a6f8-4737-a490-963d7a2308fa tempest-GroupSnapshotsV319Test-1742026067 None] Create group completed successfully.
Apr 15 16:30:35 devstack sudo[86311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638 1073741824
Apr 15 16:30:35 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:36 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638 1073741824" returned: 0 in 0.669s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:36 devstack sudo[86316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638
Apr 15 16:30:36 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:37 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638" returned: 0 in 0.570s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf38fa1-6970-43b9-b017-92e45d85c7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc12505-9103-479d-bd42-65af203eb638', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0e3b26-cb1e-4b6c-bb3f-f2f940136357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:37 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Volume volume-efc12505-9103-479d-bd42-65af203eb638 (efc12505-9103-479d-bd42-65af203eb638): created successfully
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0e3b26-cb1e-4b6c-bb3f-f2f940136357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Flow 'volume_create_manager' (5bb589a1-1c89-4a86-9322-8a9f8485994f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Flow 'volume_create_manager' (99483520-5c8f-43b9-8a31-86a515472fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80aea8c0-98cc-4637-9ab1-ef884ed04927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-529d68c8-7675-470d-9c1a-a26e46b9e433 tempest-VolumesTestJSON-1838795539 None] Created volume successfully.
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80aea8c0-98cc-4637-9ab1-ef884ed04927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-126750220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4d8e790d-9448-4ce8-923b-a89b923ab1bd,host='devstack@QuobyteHD#QuobyteHD',id=9c000de7-67fc-4181-b03f-95053c33a1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7db20a17454235b9cd989c0d93f612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:37Z,use_quota=True,user_id='5485fffea62f42159a3313a0d458d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0316591e-3c15-4063-a91a-a88713d752ee),volume_type_id=0316591e-3c15-4063-a91a-a88713d752ee)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f182b42d-628e-4927-b445-3c9b016ed18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f182b42d-628e-4927-b445-3c9b016ed18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c96f17-387e-474b-9907-46c3af8cae0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c96f17-387e-474b-9907-46c3af8cae0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c000de7-67fc-4181-b03f-95053c33a1ad', 'volume_name': 'volume-9c000de7-67fc-4181-b03f-95053c33a1ad', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89df48fc-d0f2-404e-9844-89315bd86029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89df48fc-d0f2-404e-9844-89315bd86029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31059775-8141-46a4-aef1-43bc956083cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:37 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Volume 9c000de7-67fc-4181-b03f-95053c33a1ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c000de7-67fc-4181-b03f-95053c33a1ad', 'volume_size': 1}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4d8e790d-9448-4ce8-923b-a89b923ab1bd,created_at=2026-04-15T14:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-126750220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4d8e790d-9448-4ce8-923b-a89b923ab1bd,host='devstack@QuobyteHD#QuobyteHD',id=9c000de7-67fc-4181-b03f-95053c33a1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7db20a17454235b9cd989c0d93f612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:37Z,use_quota=True,user_id='5485fffea62f42159a3313a0d458d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0316591e-3c15-4063-a91a-a88713d752ee),volume_type_id=0316591e-3c15-4063-a91a-a88713d752ee)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Creating volume 9c000de7-67fc-4181-b03f-95053c33a1ad {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:37 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:37 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad 1073741824
Apr 15 16:30:37 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:37 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad 1073741824" returned: 0 in 0.620s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:37 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad
Apr 15 16:30:37 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Flow 'volume_create_manager' (ae861404-2fbd-4e95-86b0-698f8529a9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59813156-7ba6-4931-ae09-801d3934a0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59813156-7ba6-4931-ae09-801d3934a0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1639850530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508d9b25-8af3-47eb-9610-2e41da0f16d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d33b898d54e46198abd01d4a6fc8c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:38Z,use_quota=True,user_id='c098ee99c686456991ccad1d51c167a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf697f7-c168-4982-aafa-d2cbe6858c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf697f7-c168-4982-aafa-d2cbe6858c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ca82e5-e382-40ae-9a8b-a5defb24b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ca82e5-e382-40ae-9a8b-a5defb24b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '508d9b25-8af3-47eb-9610-2e41da0f16d2', 'volume_name': 'volume-508d9b25-8af3-47eb-9610-2e41da0f16d2', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e944b06-7128-4ac4-8511-22421dea6906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e944b06-7128-4ac4-8511-22421dea6906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a50f0d-eb3e-49d0-a49e-7b7c93789880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:38 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Volume 508d9b25-8af3-47eb-9610-2e41da0f16d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-508d9b25-8af3-47eb-9610-2e41da0f16d2', 'volume_size': 1}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:38 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad" returned: 0 in 0.613s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1639850530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508d9b25-8af3-47eb-9610-2e41da0f16d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d33b898d54e46198abd01d4a6fc8c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:38Z,use_quota=True,user_id='c098ee99c686456991ccad1d51c167a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Creating volume 508d9b25-8af3-47eb-9610-2e41da0f16d2 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:38 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31059775-8141-46a4-aef1-43bc956083cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c000de7-67fc-4181-b03f-95053c33a1ad', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:38 devstack sudo[86329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2 1073741824
Apr 15 16:30:38 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1e2756-3d78-4d58-b65e-2329fc778162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:38 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Volume volume-9c000de7-67fc-4181-b03f-95053c33a1ad (9c000de7-67fc-4181-b03f-95053c33a1ad): created successfully
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1e2756-3d78-4d58-b65e-2329fc778162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Flow 'volume_create_manager' (99483520-5c8f-43b9-8a31-86a515472fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:38 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9933b12c-5ec6-4937-964b-54d0457713d3 tempest-GroupSnapshotsV319Test-1742026067 None] Created volume successfully.
Apr 15 16:30:39 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2 1073741824" returned: 0 in 0.652s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:39 devstack sudo[86334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2
Apr 15 16:30:39 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:39 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] GroupSnapshot 8333cd94-29e9-415c-9cb4-b36fdc2ff949: creating.
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Group snapshot 8333cd94-29e9-415c-9cb4-b36fdc2ff949: creating. {{(pid=82156) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:39 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2" returned: 0 in 0.579s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.228s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Creating offline snapshot d02cf74e-3ffd-4abd-ad05-ef44729a9892 of volume 9c000de7-67fc-4181-b03f-95053c33a1ad {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a50f0d-eb3e-49d0-a49e-7b7c93789880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-508d9b25-8af3-47eb-9610-2e41da0f16d2', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e32a8d-fe5b-4bfb-b3a4-244e768be5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[035b4f01-5ce6-44b5-937c-3255aa354c8e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:39 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Volume volume-508d9b25-8af3-47eb-9610-2e41da0f16d2 (508d9b25-8af3-47eb-9610-2e41da0f16d2): created successfully
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e32a8d-fe5b-4bfb-b3a4-244e768be5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Flow 'volume_create_manager' (ae861404-2fbd-4e95-86b0-698f8529a9dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:39 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8f812637-3011-42c9-ba71-25ee0fd15b2b tempest-VolumesTestJSON-1838795539 None] Created volume successfully.
Apr 15 16:30:39 devstack sudo[86337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad
Apr 15 16:30:39 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Flow 'volume_create_manager' (8595a953-f927-4aec-9c05-80e2b9374ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a5e206-4636-4d7f-adc4-7512303a4610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a5e206-4636-4d7f-adc4-7512303a4610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1784550429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918d9cbd-db03-4213-ba26-dc1960394287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6a8dac54d4336b1caa4e6677a5e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:40Z,use_quota=True,user_id='71ec8e3246ee492b97e9c00299eb19e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39458ec3-e87c-48cc-933f-fcde21fac384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39458ec3-e87c-48cc-933f-fcde21fac384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bf96f0-0059-441c-bba2-d428bed2e475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bf96f0-0059-441c-bba2-d428bed2e475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918d9cbd-db03-4213-ba26-dc1960394287', 'volume_name': 'volume-918d9cbd-db03-4213-ba26-dc1960394287', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63065b5a-521a-470d-b8b9-7948f3878a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63065b5a-521a-470d-b8b9-7948f3878a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b920c1a8-e4a1-45f5-9133-8ebe604c1467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Volume 918d9cbd-db03-4213-ba26-dc1960394287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918d9cbd-db03-4213-ba26-dc1960394287', 'volume_size': 1}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:40 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad" returned: 0 in 0.570s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:40 devstack sudo[86342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 1G
Apr 15 16:30:40 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Flow 'volume_create_manager' (a45dc691-ce27-43e0-9ed9-442e10779060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560c007c-40c1-45fa-a345-dc6b74df7566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560c007c-40c1-45fa-a345-dc6b74df7566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-574345797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cce9627-9bf4-4382-987c-5f8b845d8769,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d33b898d54e46198abd01d4a6fc8c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:41Z,use_quota=True,user_id='c098ee99c686456991ccad1d51c167a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84985223-924d-46fd-ae85-730678fb7395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84985223-924d-46fd-ae85-730678fb7395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a1993f-63dd-407a-ae1e-6c2a9e91f814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a1993f-63dd-407a-ae1e-6c2a9e91f814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cce9627-9bf4-4382-987c-5f8b845d8769', 'volume_name': 'volume-6cce9627-9bf4-4382-987c-5f8b845d8769', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707b3cc9-d195-448f-b83d-a2dc8dccbd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707b3cc9-d195-448f-b83d-a2dc8dccbd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dfafbd-f141-4654-8e37-c290bf2d05f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Volume 6cce9627-9bf4-4382-987c-5f8b845d8769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cce9627-9bf4-4382-987c-5f8b845d8769', 'volume_size': 1}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:40 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 1G" returned: 0 in 0.549s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c000de7-67fc-4181-b03f-95053c33a1ad -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:40 devstack sudo[86347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c000de7-67fc-4181-b03f-95053c33a1ad -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892
Apr 15 16:30:40 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:41 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c000de7-67fc-4181-b03f-95053c33a1ad -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892" returned: 0 in 0.475s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:41 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:30:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:41 devstack sudo[86352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892
Apr 15 16:30:41 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:41 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892" returned: 0 in 0.431s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:41 devstack sudo[86355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.info
Apr 15 16:30:41 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:42 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.info" returned: 0 in 0.461s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:42 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:42 devstack sudo[86358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.info
Apr 15 16:30:42 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:42 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.info" returned: 0 in 0.441s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.009s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1784550429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918d9cbd-db03-4213-ba26-dc1960394287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6a8dac54d4336b1caa4e6677a5e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:40Z,use_quota=True,user_id='71ec8e3246ee492b97e9c00299eb19e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Creating volume 918d9cbd-db03-4213-ba26-dc1960394287 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:42 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:42 devstack sudo[86361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287 1073741824
Apr 15 16:30:42 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:42 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-21abad77-befc-47fc-93a3-592e5ffd156c tempest-GroupSnapshotsV319Test-1742026067 None] group_snapshot 8333cd94-29e9-415c-9cb4-b36fdc2ff949: created successfully
Apr 15 16:30:43 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287 1073741824" returned: 0 in 0.585s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:43 devstack sudo[86366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287
Apr 15 16:30:43 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:43 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287" returned: 0 in 0.529s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.087s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-574345797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cce9627-9bf4-4382-987c-5f8b845d8769,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d33b898d54e46198abd01d4a6fc8c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:41Z,use_quota=True,user_id='c098ee99c686456991ccad1d51c167a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Creating volume 6cce9627-9bf4-4382-987c-5f8b845d8769 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:44 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:44 devstack sudo[86369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769 1073741824
Apr 15 16:30:44 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b920c1a8-e4a1-45f5-9133-8ebe604c1467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918d9cbd-db03-4213-ba26-dc1960394287', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c731891-7b98-45b2-adca-bbbb98d857f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:44 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Volume volume-918d9cbd-db03-4213-ba26-dc1960394287 (918d9cbd-db03-4213-ba26-dc1960394287): created successfully
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c731891-7b98-45b2-adca-bbbb98d857f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Flow 'volume_create_manager' (8595a953-f927-4aec-9c05-80e2b9374ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] group_snapshot 8333cd94-29e9-415c-9cb4-b36fdc2ff949: deleting
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] group_snapshot 8333cd94-29e9-415c-9cb4-b36fdc2ff949: deleting {{(pid=82156) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 16:30:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-92992099-7f13-46ed-a3b8-ba739aa3e8bb tempest-VolumesListAdminTestJSON-1696086637 None] Created volume successfully.
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Acquiring lock "cinder-quobyte-9c000de7-67fc-4181-b03f-95053c33a1ad" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Lock "cinder-quobyte-9c000de7-67fc-4181-b03f-95053c33a1ad" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Acquiring lock "cinder-quobyte-d02cf74e-3ffd-4abd-ad05-ef44729a9892" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Lock "cinder-quobyte-d02cf74e-3ffd-4abd-ad05-ef44729a9892" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Deleting offline snapshot d02cf74e-3ffd-4abd-ad05-ef44729a9892 of volume 9c000de7-67fc-4181-b03f-95053c33a1ad {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] snapshot_file for this snap is: volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[98053db2-e7f5-412d-b8a9-0efe60aa29bc]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:44 devstack sudo[86371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892
Apr 15 16:30:44 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Flow 'volume_create_manager' (b8e4d98b-6aae-4e63-a94c-f2870e3071cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d180097-bed2-433b-b320-45fd5b413161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d180097-bed2-433b-b320-45fd5b413161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-186074621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2e6e36-9af4-4564-a81d-8d06bb0428b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6a8dac54d4336b1caa4e6677a5e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:44Z,use_quota=True,user_id='71ec8e3246ee492b97e9c00299eb19e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7003bb8d-a804-4ff9-aeae-2096f63a5140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7003bb8d-a804-4ff9-aeae-2096f63a5140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68fb319-7136-4511-91ad-5fbc01a3e157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68fb319-7136-4511-91ad-5fbc01a3e157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2e6e36-9af4-4564-a81d-8d06bb0428b3', 'volume_name': 'volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d37402d-57d3-4815-93b7-c6ee3c186fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d37402d-57d3-4815-93b7-c6ee3c186fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3818f8b8-3efd-4184-90d5-f1a95eb4fecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:44 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Volume 3a2e6e36-9af4-4564-a81d-8d06bb0428b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3', 'volume_size': 1}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:44 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769 1073741824" returned: 0 in 0.618s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:44 devstack sudo[86376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769
Apr 15 16:30:44 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:44 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892" returned: 0 in 0.602s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c000de7-67fc-4181-b03f-95053c33a1ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e749f7b-e2f9-4903-9517-004ec1a79c92]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:44 devstack sudo[86381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad
Apr 15 16:30:44 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:45 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769" returned: 0 in 0.480s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-186074621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2e6e36-9af4-4564-a81d-8d06bb0428b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6a8dac54d4336b1caa4e6677a5e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:44Z,use_quota=True,user_id='71ec8e3246ee492b97e9c00299eb19e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Creating volume 3a2e6e36-9af4-4564-a81d-8d06bb0428b3 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:45 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dfafbd-f141-4654-8e37-c290bf2d05f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cce9627-9bf4-4382-987c-5f8b845d8769', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:45 devstack sudo[86384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3 1073741824
Apr 15 16:30:45 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c624f7-d6a0-44eb-a6f3-393a9ac55e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:45 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Volume volume-6cce9627-9bf4-4382-987c-5f8b845d8769 (6cce9627-9bf4-4382-987c-5f8b845d8769): created successfully
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c624f7-d6a0-44eb-a6f3-393a9ac55e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Flow 'volume_create_manager' (a45dc691-ce27-43e0-9ed9-442e10779060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:45 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e19e3823-31fd-40d7-9e44-c669747f61f5 tempest-VolumesTestJSON-1838795539 None] Created volume successfully.
Apr 15 16:30:45 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad" returned: 0 in 0.557s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:45 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892
Apr 15 16:30:45 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Flow 'volume_create_manager' (0ddb64d2-d42b-4907-9bee-13c1ee87b1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960adac0-4c4e-4599-a205-cffc8c73867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960adac0-4c4e-4599-a205-cffc8c73867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-332053627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33aabdc2-0038-4b5f-8250-ba40f4874915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cf90cc1d54aefbdd7d72719fa20e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:45Z,use_quota=True,user_id='9e818586eda84391a78d21f2768fdc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70e1a4d-646d-4410-8e6f-23a4420c8c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70e1a4d-646d-4410-8e6f-23a4420c8c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcf5737-3009-4e8e-b94c-01729606890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcf5737-3009-4e8e-b94c-01729606890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33aabdc2-0038-4b5f-8250-ba40f4874915', 'volume_name': 'volume-33aabdc2-0038-4b5f-8250-ba40f4874915', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7b11c1-f82d-442a-8205-cd66d4de3113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7b11c1-f82d-442a-8205-cd66d4de3113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf59e7a3-585b-4734-9f9b-a742cdf3a711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:45 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Volume 33aabdc2-0038-4b5f-8250-ba40f4874915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33aabdc2-0038-4b5f-8250-ba40f4874915', 'volume_size': 1}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:45 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3 1073741824" returned: 0 in 0.553s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:45 devstack sudo[86397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3
Apr 15 16:30:45 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:45 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892" returned: 0 in 0.483s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:45 devstack sudo[86399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892
Apr 15 16:30:45 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:46 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3" returned: 0 in 0.424s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-332053627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33aabdc2-0038-4b5f-8250-ba40f4874915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cf90cc1d54aefbdd7d72719fa20e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:45Z,use_quota=True,user_id='9e818586eda84391a78d21f2768fdc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Creating volume 33aabdc2-0038-4b5f-8250-ba40f4874915 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:46 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:46 devstack sudo[86403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915 1073741824
Apr 15 16:30:46 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3818f8b8-3efd-4184-90d5-f1a95eb4fecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fd98b1-77a3-4be3-bb0d-754ce606b751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:46 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Volume volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3 (3a2e6e36-9af4-4564-a81d-8d06bb0428b3): created successfully
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fd98b1-77a3-4be3-bb0d-754ce606b751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:46 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Flow 'volume_create_manager' (b8e4d98b-6aae-4e63-a94c-f2870e3071cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad.d02cf74e-3ffd-4abd-ad05-ef44729a9892" returned: 0 in 0.449s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Lock "cinder-quobyte-d02cf74e-3ffd-4abd-ad05-ef44729a9892" released by "_delete_snapshot" :: held 2.155s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Lock "cinder-quobyte-9c000de7-67fc-4181-b03f-95053c33a1ad" released by "delete_snapshot" :: held 2.169s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:46 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-550b2e82-b0e0-4c53-89b2-0b77cfb74ed4 tempest-VolumesListAdminTestJSON-1696086637 None] Created volume successfully.
Apr 15 16:30:46 devstack cinder-volume[82156]: WARNING cinder.quota [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-175114590 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-175114590, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:30:46 devstack cinder-volume[82156]: WARNING cinder.quota [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-175114590 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-175114590, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] Created reservations ['5cb6dd32-031e-4fb9-b3d6-e831c6eca6d3', 'f7fec984-0c86-4405-91d6-f26ed8a53487', '66de01cb-b7e7-4e7b-b4c8-cf5c31875e07', 'a2892cc4-6358-4f20-aec1-7a49012aabfc'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:46 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-111f7aa9-e66f-44ca-84a1-82d1ebec09fe tempest-GroupSnapshotsV319Test-1742026067 None] group_snapshot 8333cd94-29e9-415c-9cb4-b36fdc2ff949: deleted successfully
Apr 15 16:30:46 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915 1073741824" returned: 0 in 0.615s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:46 devstack sudo[86408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915
Apr 15 16:30:46 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "cinder-6cce9627-9bf4-4382-987c-5f8b845d8769-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Lock "cinder-6cce9627-9bf4-4382-987c-5f8b845d8769-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "cinder-quobyte-6cce9627-9bf4-4382-987c-5f8b845d8769" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Lock "cinder-quobyte-6cce9627-9bf4-4382-987c-5f8b845d8769" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f56d1d-0da2-48c7-b678-88de8cdb7585]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Flow 'volume_create_manager' (a597ecef-7e23-41a1-b94f-12f6a6adb39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af498c6-581c-478d-8f86-108f8361c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af498c6-581c-478d-8f86-108f8361c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-186523420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abce197c-5dab-4e8c-b649-579a77bfd855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6a8dac54d4336b1caa4e6677a5e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:47Z,use_quota=True,user_id='71ec8e3246ee492b97e9c00299eb19e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62414de-df81-4f15-8e31-4dc9f704157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62414de-df81-4f15-8e31-4dc9f704157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:46 devstack sudo[86410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769
Apr 15 16:30:46 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9240fe9a-6280-4cf0-920e-68cf714782b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9240fe9a-6280-4cf0-920e-68cf714782b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abce197c-5dab-4e8c-b649-579a77bfd855', 'volume_name': 'volume-abce197c-5dab-4e8c-b649-579a77bfd855', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18448ad4-76eb-4a59-81b8-a6212d08544d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18448ad4-76eb-4a59-81b8-a6212d08544d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7080a913-f9ca-464c-985a-7897a47ac44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:47 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Volume abce197c-5dab-4e8c-b649-579a77bfd855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abce197c-5dab-4e8c-b649-579a77bfd855', 'volume_size': 1}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:47 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915" returned: 0 in 0.442s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.234s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-186523420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abce197c-5dab-4e8c-b649-579a77bfd855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6a8dac54d4336b1caa4e6677a5e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:47Z,use_quota=True,user_id='71ec8e3246ee492b97e9c00299eb19e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Creating volume abce197c-5dab-4e8c-b649-579a77bfd855 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:47 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf59e7a3-585b-4734-9f9b-a742cdf3a711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33aabdc2-0038-4b5f-8250-ba40f4874915', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcc0b14-e622-4c68-8e4c-f0158194cd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:47 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855 1073741824
Apr 15 16:30:47 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:47 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Volume volume-33aabdc2-0038-4b5f-8250-ba40f4874915 (33aabdc2-0038-4b5f-8250-ba40f4874915): created successfully
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcc0b14-e622-4c68-8e4c-f0158194cd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Flow 'volume_create_manager' (0ddb64d2-d42b-4907-9bee-13c1ee87b1de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:47 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6f0e4505-280d-40c2-ad12-0a1f72c607b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Created volume successfully.
Apr 15 16:30:47 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769" returned: 0 in 0.500s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:47 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769
Apr 15 16:30:47 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Acquiring lock "cinder-quobyte-9c000de7-67fc-4181-b03f-95053c33a1ad" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Lock "cinder-quobyte-9c000de7-67fc-4181-b03f-95053c33a1ad" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[454b2afc-5436-4c82-85f7-b62cecd2d0f3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:47 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad
Apr 15 16:30:47 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:47 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855 1073741824" returned: 0 in 0.550s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:47 devstack sudo[86427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855
Apr 15 16:30:47 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:47 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cce9627-9bf4-4382-987c-5f8b845d8769" returned: 0 in 0.438s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Lock "cinder-quobyte-6cce9627-9bf4-4382-987c-5f8b845d8769" released by "delete_volume" :: held 0.961s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Created reservations ['b7e456fc-742b-4411-8711-d8c16efebb58', '1d5a54bb-0222-4f2f-afda-55a1dd56a5fc', 'aa69fb2b-6296-431b-b458-db57224fe0d5', 'bfc99eec-f5fc-4131-ab12-bdf8146a7eb7'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:47 devstack sudo[86429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:47 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "cinder-508d9b25-8af3-47eb-9610-2e41da0f16d2-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Lock "cinder-508d9b25-8af3-47eb-9610-2e41da0f16d2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "cinder-quobyte-508d9b25-8af3-47eb-9610-2e41da0f16d2" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Lock "cinder-quobyte-508d9b25-8af3-47eb-9610-2e41da0f16d2" acquired by "delete_volume" :: waited 0.016s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c07fa9-33bb-46e4-9c07-a2adcd38a031]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:48 devstack sudo[86434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2
Apr 15 16:30:48 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:48 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad" returned: 0 in 0.635s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:48 devstack sudo[86436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad
Apr 15 16:30:48 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:48 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855" returned: 0 in 0.475s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.583s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Creating offline snapshot be5edc76-3506-44a6-a4ba-7757edbfda69 of volume 33aabdc2-0038-4b5f-8250-ba40f4874915 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7080a913-f9ca-464c-985a-7897a47ac44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abce197c-5dab-4e8c-b649-579a77bfd855', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668d6565-8cfb-458f-ad56-d15fc7792428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe319a97-458b-411e-9abf-197e5b5acb99]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:48 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Volume volume-abce197c-5dab-4e8c-b649-579a77bfd855 (abce197c-5dab-4e8c-b649-579a77bfd855): created successfully
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668d6565-8cfb-458f-ad56-d15fc7792428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Flow 'volume_create_manager' (a597ecef-7e23-41a1-b94f-12f6a6adb39d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:48 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-41fbcfed-ddfd-428a-8b09-cb4b009b84f9 tempest-VolumesListAdminTestJSON-1696086637 None] Created volume successfully.
Apr 15 16:30:48 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.464s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:48 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Deleted volume successfully.
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-768288eb-ff3f-48dc-a061-e0b996ac9f51 tempest-VolumesTestJSON-1838795539 None] Lock "cinder-6cce9627-9bf4-4382-987c-5f8b845d8769-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:48 devstack sudo[86442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915
Apr 15 16:30:48 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:48 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2" returned: 0 in 0.530s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:48 devstack sudo[86448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2
Apr 15 16:30:48 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:48 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9c000de7-67fc-4181-b03f-95053c33a1ad" returned: 0 in 0.519s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Lock "cinder-quobyte-9c000de7-67fc-4181-b03f-95053c33a1ad" released by "delete_volume" :: held 1.197s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Created reservations ['f1472111-c1ee-4f09-ab44-4cf87ab3e62d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:48 devstack cinder-volume[82156]: WARNING cinder.quota [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-175114590 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-175114590, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Created reservations ['63e01710-bcae-4c38-bcc3-eb67d2f49a6f', 'ca2c265c-d707-465b-ac8e-5e9aab531dab', 'd367463c-145d-45f6-b6aa-f10492baee03', '653bcc6f-646f-4461-8df8-31bc4a61d375'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:48 devstack sudo[86453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:48 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:48 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915" returned: 0 in 0.535s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:48 devstack sudo[86455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 1G
Apr 15 16:30:48 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:49 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-508d9b25-8af3-47eb-9610-2e41da0f16d2" returned: 0 in 0.450s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Lock "cinder-quobyte-508d9b25-8af3-47eb-9610-2e41da0f16d2" released by "delete_volume" :: held 1.011s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Created reservations ['3b17539c-6e88-410f-99d4-03dcf41992c7', '807f1db8-3cc2-4abe-ab64-74a81dd6fbf8', '98240e3e-a7d6-481d-9c4b-ae56afe7fb8e', 'cb624bd9-258c-44b2-aeb6-4811925d45fd'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:49 devstack sudo[86458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:49 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:49 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.460s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:49 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cc7287e4-5b49-451e-943e-c353015f14bc tempest-GroupSnapshotsV319Test-1742026067 None] Delete group completed successfully.
Apr 15 16:30:49 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 1G" returned: 0 in 0.560s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33aabdc2-0038-4b5f-8250-ba40f4874915 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:49 devstack sudo[86464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33aabdc2-0038-4b5f-8250-ba40f4874915 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69
Apr 15 16:30:49 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Flow 'volume_create_manager' (f895626e-5022-4754-a0fe-cfcb306daf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5352d049-5872-4ca6-8a20-e54f625ccc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5352d049-5872-4ca6-8a20-e54f625ccc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec832b2f-265c-493b-9e5e-58e8b78fc708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5370071bdff24195aeaffd21ed91ace7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:49Z,use_quota=True,user_id='b9042b625d22490894fcdba480a96407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3690c1-66a6-4fea-80fd-b26dbbec2993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3690c1-66a6-4fea-80fd-b26dbbec2993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bdc1ab-c5f5-4a04-acb7-6b16de34eb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bdc1ab-c5f5-4a04-acb7-6b16de34eb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec832b2f-265c-493b-9e5e-58e8b78fc708', 'volume_name': 'volume-ec832b2f-265c-493b-9e5e-58e8b78fc708', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7908e598-1c9e-426f-9710-23ff327c5782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7908e598-1c9e-426f-9710-23ff327c5782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed17b2c-5848-40cb-b881-6900bd7d3a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:49 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Volume ec832b2f-265c-493b-9e5e-58e8b78fc708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec832b2f-265c-493b-9e5e-58e8b78fc708', 'volume_size': 1}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:49 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.542s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:49 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Deleted volume successfully.
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e925475c-6341-456f-b60c-e19dd2659e05 tempest-VolumesTestJSON-1838795539 None] Lock "cinder-508d9b25-8af3-47eb-9610-2e41da0f16d2-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:49 devstack sudo[86470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:49 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:49 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33aabdc2-0038-4b5f-8250-ba40f4874915 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69" returned: 0 in 0.455s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:49 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 is being set with open permissions: ugo+rw
Apr 15 16:30:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:49 devstack sudo[86472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69
Apr 15 16:30:49 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Acquiring lock "cinder-efc12505-9103-479d-bd42-65af203eb638-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Lock "cinder-efc12505-9103-479d-bd42-65af203eb638-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Acquiring lock "cinder-quobyte-efc12505-9103-479d-bd42-65af203eb638" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Lock "cinder-quobyte-efc12505-9103-479d-bd42-65af203eb638" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e973ec9-3354-44f6-aa71-21f368336dd8]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:50 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.510s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:50 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69" returned: 0 in 0.485s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:50 devstack sudo[86476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638
Apr 15 16:30:50 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:50 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.info
Apr 15 16:30:50 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:50 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.info" returned: 0 in 0.461s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:50 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.info is being set with open permissions: ugo+rw
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:50 devstack sudo[86484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.info
Apr 15 16:30:50 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:50 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638" returned: 0 in 0.626s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:50 devstack sudo[86486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638
Apr 15 16:30:50 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:51 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.info" returned: 0 in 0.460s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.794s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec832b2f-265c-493b-9e5e-58e8b78fc708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5370071bdff24195aeaffd21ed91ace7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:30:49Z,use_quota=True,user_id='b9042b625d22490894fcdba480a96407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Creating volume ec832b2f-265c-493b-9e5e-58e8b78fc708 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:30:51 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:51 devstack sudo[86490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708 1073741824
Apr 15 16:30:51 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:51 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-efc12505-9103-479d-bd42-65af203eb638" returned: 0 in 0.455s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5aa779c2-3ee1-413d-8650-edc0580ce009 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Create snapshot completed successfully
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Lock "cinder-quobyte-efc12505-9103-479d-bd42-65af203eb638" released by "delete_volume" :: held 1.117s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Created reservations ['2a1d7023-8dbe-4ace-8526-48b3c23950ba', 'd9a83f3e-85cf-4728-bce2-ed2c882081f3', '6705e5d3-2e52-4530-9db2-074ed0747967', '58ab8317-28ef-4553-bea1-32e09c8d2a7b'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:51 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:51 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:51 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708 1073741824" returned: 0 in 0.533s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:51 devstack sudo[86498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708
Apr 15 16:30:51 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:51 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.522s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Deleted volume successfully.
Apr 15 16:30:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-169e9fa9-e0d2-486b-99c2-1ed705db34fa tempest-VolumesTestJSON-1838795539 None] Lock "cinder-efc12505-9103-479d-bd42-65af203eb638-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Acquiring lock "cinder-be5edc76-3506-44a6-a4ba-7757edbfda69-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-be5edc76-3506-44a6-a4ba-7757edbfda69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Acquiring lock "cinder-quobyte-33aabdc2-0038-4b5f-8250-ba40f4874915" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-quobyte-33aabdc2-0038-4b5f-8250-ba40f4874915" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Acquiring lock "cinder-quobyte-be5edc76-3506-44a6-a4ba-7757edbfda69" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-quobyte-be5edc76-3506-44a6-a4ba-7757edbfda69" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Deleting offline snapshot be5edc76-3506-44a6-a4ba-7757edbfda69 of volume 33aabdc2-0038-4b5f-8250-ba40f4874915 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] snapshot_file for this snap is: volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6680883-2612-49a5-81a5-498206ce9bfc]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:52 devstack sudo[86500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69
Apr 15 16:30:52 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:52 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708" returned: 0 in 0.493s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed17b2c-5848-40cb-b881-6900bd7d3a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec832b2f-265c-493b-9e5e-58e8b78fc708', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709794bf-2545-42f8-a3aa-a4cc1b745ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:30:52 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Volume volume-ec832b2f-265c-493b-9e5e-58e8b78fc708 (ec832b2f-265c-493b-9e5e-58e8b78fc708): created successfully
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709794bf-2545-42f8-a3aa-a4cc1b745ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Flow 'volume_create_manager' (f895626e-5022-4754-a0fe-cfcb306daf1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:30:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3c54b250-5b85-4334-9b74-35c6e099bcc2 tempest-VolumesListAdminTestJSON-48929271 None] Created volume successfully.
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Acquiring lock "cinder-ec832b2f-265c-493b-9e5e-58e8b78fc708-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Lock "cinder-ec832b2f-265c-493b-9e5e-58e8b78fc708-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Acquiring lock "cinder-quobyte-ec832b2f-265c-493b-9e5e-58e8b78fc708" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Lock "cinder-quobyte-ec832b2f-265c-493b-9e5e-58e8b78fc708" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:52 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69" returned: 0 in 0.629s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33aabdc2-0038-4b5f-8250-ba40f4874915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a6824b-50f2-4f56-9509-66680497faa6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "cinder-abce197c-5dab-4e8c-b649-579a77bfd855-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e38e283-7a2b-4c4d-8426-93a73fec7679]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-abce197c-5dab-4e8c-b649-579a77bfd855-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "cinder-quobyte-abce197c-5dab-4e8c-b649-579a77bfd855" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-quobyte-abce197c-5dab-4e8c-b649-579a77bfd855" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:52 devstack sudo[86507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05b5160-eaa6-4389-976a-e1113f450c8b]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:52 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:52 devstack sudo[86506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708
Apr 15 16:30:52 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:53 devstack sudo[86509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855
Apr 15 16:30:53 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:53 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915" returned: 0 in 0.670s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:53 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708" returned: 0 in 0.710s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:53 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69
Apr 15 16:30:53 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:53 devstack sudo[86522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708
Apr 15 16:30:53 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:53 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855" returned: 0 in 0.672s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:53 devstack sudo[86525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855
Apr 15 16:30:53 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:54 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec832b2f-265c-493b-9e5e-58e8b78fc708" returned: 0 in 0.626s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Lock "cinder-quobyte-ec832b2f-265c-493b-9e5e-58e8b78fc708" released by "delete_volume" :: held 1.386s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:54 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69" returned: 0 in 0.702s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:54 devstack sudo[86532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69
Apr 15 16:30:54 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Created reservations ['85e7a2e9-d912-42b1-899a-3f4f98ed6d49', 'e60b1999-fb64-419a-8e2e-10fc85fbd34f', 'f34aff67-0dbf-4039-8700-a80b6085226f', '5b80c6d6-b315-4667-ac3a-598b0454de58'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:54 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-abce197c-5dab-4e8c-b649-579a77bfd855" returned: 0 in 0.670s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-quobyte-abce197c-5dab-4e8c-b649-579a77bfd855" released by "delete_volume" :: held 1.376s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Created reservations ['4475d7fa-e081-4ae2-be17-31a7a3995f73', 'fef73f70-b574-4112-9eb9-a2d5b547c04a', '5d4836fc-e580-4e98-80e1-424250cc76c0', '74cce30e-e980-442f-af6f-363a0e4cc2ad'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:54 devstack sudo[86534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:54 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:54 devstack sudo[86536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:54 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:54 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915.be5edc76-3506-44a6-a4ba-7757edbfda69" returned: 0 in 0.580s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-quobyte-be5edc76-3506-44a6-a4ba-7757edbfda69" released by "_delete_snapshot" :: held 2.690s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-quobyte-33aabdc2-0038-4b5f-8250-ba40f4874915" released by "delete_snapshot" :: held 2.701s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Created reservations ['9b93139f-261a-4b91-a577-0d5c18bdbdf1', 'a43dfc27-6e02-4ef1-9d37-4badb62134d9', 'dfc73961-b701-4ed2-b8e1-54d031bca5b9', 'dc8f0347-edb2-43a9-8435-77a8541b6606'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:54 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Delete snapshot completed successfully.
Apr 15 16:30:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-456c2f52-f8b5-4414-a9f9-a969631b1fcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-be5edc76-3506-44a6-a4ba-7757edbfda69-delete_snapshot" released by "delete_snapshot" :: held 2.858s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:55 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.664s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:55 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:55 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Deleted volume successfully.
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.613s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:55 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Deleted volume successfully.
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b26c31a5-5df3-4355-801b-48c010ec4a1d tempest-VolumesListAdminTestJSON-48929271 None] Lock "cinder-ec832b2f-265c-493b-9e5e-58e8b78fc708-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-30a09416-ffa5-43d8-8527-c2cedfb2c168 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-abce197c-5dab-4e8c-b649-579a77bfd855-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "cinder-3a2e6e36-9af4-4564-a81d-8d06bb0428b3-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-3a2e6e36-9af4-4564-a81d-8d06bb0428b3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "cinder-quobyte-3a2e6e36-9af4-4564-a81d-8d06bb0428b3" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-quobyte-3a2e6e36-9af4-4564-a81d-8d06bb0428b3" acquired by "delete_volume" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5de8e1-c68a-48d1-8982-54d0666143b8]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:55 devstack sudo[86541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3
Apr 15 16:30:55 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Acquiring lock "cinder-33aabdc2-0038-4b5f-8250-ba40f4874915-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-33aabdc2-0038-4b5f-8250-ba40f4874915-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Acquiring lock "cinder-quobyte-33aabdc2-0038-4b5f-8250-ba40f4874915" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-quobyte-33aabdc2-0038-4b5f-8250-ba40f4874915" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da32e2-95f3-4b9f-bfe3-6fe143b85779]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:55 devstack sudo[86543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915
Apr 15 16:30:55 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:55 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3" returned: 0 in 0.675s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:55 devstack sudo[86548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3
Apr 15 16:30:55 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:56 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915" returned: 0 in 0.587s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:56 devstack sudo[86553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915
Apr 15 16:30:56 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:56 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3a2e6e36-9af4-4564-a81d-8d06bb0428b3" returned: 0 in 0.473s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-quobyte-3a2e6e36-9af4-4564-a81d-8d06bb0428b3" released by "delete_volume" :: held 1.175s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Created reservations ['8eba2958-2627-41d6-9b5e-2104a51e2b61', '5222dc5d-6509-49d4-8ac7-c0413653c6ce', '062ae526-cec0-48dd-9163-f118dd6e138a', '0bb7767e-c147-4725-a8a5-6ff6d0a8675c'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:56 devstack sudo[86557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:56 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:56 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-33aabdc2-0038-4b5f-8250-ba40f4874915" returned: 0 in 0.477s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-quobyte-33aabdc2-0038-4b5f-8250-ba40f4874915" released by "delete_volume" :: held 1.094s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Created reservations ['e2eef9b7-3bca-4d1a-be31-04d66731f449', '7404db57-7b46-4c57-8e89-7fceadfa918f', '0f221f8c-196d-401d-9d4a-b65bc29bb259', 'a908bd34-8de5-40b9-a836-daa9dfa45c7f'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:56 devstack sudo[86559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:56 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:56 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7c490338-cd23-4342-9b15-159f2ea3e988 tempest-GroupsV320Test-2077209529 None] Group tempest-GroupsV320Test-Group-1647191960: creating
Apr 15 16:30:56 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7c490338-cd23-4342-9b15-159f2ea3e988 tempest-GroupsV320Test-2077209529 None] Group tempest-GroupsV320Test-Group-1647191960: created successfully
Apr 15 16:30:56 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7c490338-cd23-4342-9b15-159f2ea3e988 tempest-GroupsV320Test-2077209529 None] Create group completed successfully.
Apr 15 16:30:56 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.481s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:56 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Deleted volume successfully.
Apr 15 16:30:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-377e8215-c287-4e08-8257-ad4b0d17510b tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-3a2e6e36-9af4-4564-a81d-8d06bb0428b3-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:57 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:57 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:57 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Deleted volume successfully.
Apr 15 16:30:57 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-11718dae-548e-468e-9954-351e5c830525 tempest-VolumeSnapshotQuotasNegativeTestJSON-1116728328 None] Lock "cinder-33aabdc2-0038-4b5f-8250-ba40f4874915-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:57 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "cinder-918d9cbd-db03-4213-ba26-dc1960394287-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:57 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-918d9cbd-db03-4213-ba26-dc1960394287-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:57 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "cinder-quobyte-918d9cbd-db03-4213-ba26-dc1960394287" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:30:57 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-quobyte-918d9cbd-db03-4213-ba26-dc1960394287" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:30:57 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b1a003-e3d5-48fc-bba9-561a7b3865dc]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:30:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:57 devstack sudo[86564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287
Apr 15 16:30:57 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:58 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287" returned: 0 in 0.563s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:58 devstack sudo[86569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287
Apr 15 16:30:58 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] Created reservations ['77354ea3-682e-4812-b320-a88f9d7de72c'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:58 devstack sudo[86571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:58 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:58 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-918d9cbd-db03-4213-ba26-dc1960394287" returned: 0 in 0.515s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-quobyte-918d9cbd-db03-4213-ba26-dc1960394287" released by "delete_volume" :: held 1.108s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Created reservations ['3dd5ab85-abc8-4a25-a470-53a349574db0', 'dbf2cafb-90d6-4b06-bf27-63f8e6b8533d', 'f4b0b8d1-8aab-4dff-95cc-3f600a19aa34', '7fdef277-31f6-4fc7-a710-4f00a6787dea'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:30:58 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.494s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:58 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2a97ba1c-0894-4eaf-9107-8b452db05226 tempest-GroupsV320Test-2077209529 None] Delete group completed successfully.
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:30:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:30:58 devstack sudo[86575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:30:58 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:30:59 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root
Apr 15 16:30:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:30:59 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:30:59 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Deleted volume successfully.
Apr 15 16:30:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3ccacf1f-9891-4b28-bd52-bf565e9ff7f0 tempest-VolumesListAdminTestJSON-1696086637 None] Lock "cinder-918d9cbd-db03-4213-ba26-dc1960394287-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=206,cinder:UPDATE=267,cinder:DELETE=20,cinder:INSERT=56 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:UPDATE=272,cinder:DELETE=19,cinder:SELECT=208,cinder:INSERT=66 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Flow 'volume_create_manager' (0731e8bc-4fdd-4d61-9ae5-dfd5afdd8995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886a27e3-29a4-4b45-b8cb-02b84eebb799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886a27e3-29a4-4b45-b8cb-02b84eebb799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-913810467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57caf43d-ed41-4b55-9cd3-fdd50bc38577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67bfbaae74145f3857ee3d19f918414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:02Z,use_quota=True,user_id='c02e6984323e4f91ad7096443b2d64ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9876c913-7773-4dfd-907a-137e88f80011),volume_type_id=9876c913-7773-4dfd-907a-137e88f80011)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f726dc05-1522-437f-a0fa-a6c347b5c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f726dc05-1522-437f-a0fa-a6c347b5c158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff87354-13d7-4546-b564-c0805886495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff87354-13d7-4546-b564-c0805886495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57caf43d-ed41-4b55-9cd3-fdd50bc38577', 'volume_name': 'volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07d89cb-fb59-4a70-8662-667d5de14cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07d89cb-fb59-4a70-8662-667d5de14cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a510b1cd-cd2c-480e-92be-25c28157ecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:02 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Volume 57caf43d-ed41-4b55-9cd3-fdd50bc38577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577', 'volume_size': 1}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-913810467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57caf43d-ed41-4b55-9cd3-fdd50bc38577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67bfbaae74145f3857ee3d19f918414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:02Z,use_quota=True,user_id='c02e6984323e4f91ad7096443b2d64ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9876c913-7773-4dfd-907a-137e88f80011),volume_type_id=9876c913-7773-4dfd-907a-137e88f80011)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Creating volume 57caf43d-ed41-4b55-9cd3-fdd50bc38577 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:02 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:02 devstack sudo[86578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577 1073741824
Apr 15 16:31:02 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:03 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577 1073741824" returned: 0 in 0.646s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:03 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577
Apr 15 16:31:03 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Flow 'volume_create_manager' (357873fb-c48b-4a44-9593-801a447932bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02bdaa7-f30e-422f-b4aa-821278f1012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02bdaa7-f30e-422f-b4aa-821278f1012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-87600312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701f4970-6fa3-42f8-af1d-3e6abca582b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae475852cdd46839a970b92768bb91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:03Z,use_quota=True,user_id='b535e7edb34845309ffa4540da3fe131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d522305e-9d44-4145-88a6-4a088cd3309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d522305e-9d44-4145-88a6-4a088cd3309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceacf1e-1361-41aa-9491-90160d2a075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceacf1e-1361-41aa-9491-90160d2a075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701f4970-6fa3-42f8-af1d-3e6abca582b5', 'volume_name': 'volume-701f4970-6fa3-42f8-af1d-3e6abca582b5', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c6299e-cc45-40e0-93a5-128a748586dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c6299e-cc45-40e0-93a5-128a748586dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd41620a-b285-4b35-82f2-382c0e7d33d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:03 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Volume 701f4970-6fa3-42f8-af1d-3e6abca582b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701f4970-6fa3-42f8-af1d-3e6abca582b5', 'volume_size': 1}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:03 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577" returned: 0 in 0.533s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-87600312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701f4970-6fa3-42f8-af1d-3e6abca582b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae475852cdd46839a970b92768bb91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:03Z,use_quota=True,user_id='b535e7edb34845309ffa4540da3fe131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Creating volume 701f4970-6fa3-42f8-af1d-3e6abca582b5 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:03 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a510b1cd-cd2c-480e-92be-25c28157ecc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1826e87c-5ef8-42d1-b11b-7c5014a11a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:03 devstack sudo[86587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 1073741824
Apr 15 16:31:03 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:03 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Volume volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577 (57caf43d-ed41-4b55-9cd3-fdd50bc38577): created successfully
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1826e87c-5ef8-42d1-b11b-7c5014a11a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Flow 'volume_create_manager' (0731e8bc-4fdd-4d61-9ae5-dfd5afdd8995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:03 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6f49958c-86d3-4e57-aaa2-5cbbc2b534bc tempest-VolumeTypesAccessTest-1042620601 None] Created volume successfully.
Apr 15 16:31:04 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 1073741824" returned: 0 in 0.668s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:04 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5
Apr 15 16:31:04 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Acquiring lock "cinder-57caf43d-ed41-4b55-9cd3-fdd50bc38577-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Lock "cinder-57caf43d-ed41-4b55-9cd3-fdd50bc38577-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Acquiring lock "cinder-quobyte-57caf43d-ed41-4b55-9cd3-fdd50bc38577" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Lock "cinder-quobyte-57caf43d-ed41-4b55-9cd3-fdd50bc38577" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:04 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d475aa1-4c77-4abf-aa9a-6a7bfb700f7c]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:04 devstack sudo[86594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577
Apr 15 16:31:04 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:05 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5" returned: 0 in 0.559s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd41620a-b285-4b35-82f2-382c0e7d33d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701f4970-6fa3-42f8-af1d-3e6abca582b5', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e4a779-32b5-4679-be8f-1a3a0bb6df96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Volume volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 (701f4970-6fa3-42f8-af1d-3e6abca582b5): created successfully
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e4a779-32b5-4679-be8f-1a3a0bb6df96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Flow 'volume_create_manager' (357873fb-c48b-4a44-9593-801a447932bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:05 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e0658acb-65dc-47dc-b610-33b76e8fe8bf tempest-SnapshotMetadataTestJSON-1047954108 None] Created volume successfully.
Apr 15 16:31:05 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577" returned: 0 in 0.683s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:05 devstack sudo[86600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577
Apr 15 16:31:05 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Creating offline snapshot ea589dce-bdb6-4ee1-8309-61a15ccb205c of volume 701f4970-6fa3-42f8-af1d-3e6abca582b5 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3ad05a-4e23-4571-824e-7d80cd5b7516]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:06 devstack sudo[86602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5
Apr 15 16:31:06 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:06 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-57caf43d-ed41-4b55-9cd3-fdd50bc38577" returned: 0 in 0.589s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Lock "cinder-quobyte-57caf43d-ed41-4b55-9cd3-fdd50bc38577" released by "delete_volume" :: held 1.305s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:06 devstack cinder-volume[82156]: WARNING cinder.quota [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1576102559 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1576102559, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:31:06 devstack cinder-volume[82156]: WARNING cinder.quota [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1576102559 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1576102559, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Created reservations ['ab4c845a-7aa0-4239-82e6-f1318cf4e260', 'ff8dfde3-bf64-4ec8-97a3-b4cfa9cd1004', '20464b1c-7ec2-4125-9de2-896c4754396c', 'e5ad2a1c-915a-4048-8448-56b4ca603f1d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:06 devstack sudo[86605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:06 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:06 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5" returned: 0 in 0.612s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:06 devstack sudo[86610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c 1G
Apr 15 16:31:06 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:06 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.505s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:06 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Deleted volume successfully.
Apr 15 16:31:06 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2ee4fe80-e2c9-497f-aba3-7c589b82f4f3 tempest-VolumeTypesAccessTest-1042620601 None] Lock "cinder-57caf43d-ed41-4b55-9cd3-fdd50bc38577-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Flow 'volume_create_manager' (ea6b061c-8411-4513-9176-dd17b655058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53603bc-4ecf-40ea-a356-bd704d15d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:07 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53603bc-4ecf-40ea-a356-bd704d15d352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-43413113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df9db19-85fd-43dc-bb75-347a6d2edd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db93332198c1403f91256c2d9e47ef8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:07Z,use_quota=True,user_id='56eca02eef1347c2af4084fa55f48f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d698da2-ed09-45e7-b759-adcb42c2eecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d698da2-ed09-45e7-b759-adcb42c2eecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d670a9ba-9166-488b-962b-e363aaba877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d670a9ba-9166-488b-962b-e363aaba877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df9db19-85fd-43dc-bb75-347a6d2edd64', 'volume_name': 'volume-2df9db19-85fd-43dc-bb75-347a6d2edd64', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3fb235-087a-4920-bd89-1cf48a0f837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3fb235-087a-4920-bd89-1cf48a0f837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966dfb73-6950-42da-952e-68ca79a28815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:07 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Volume 2df9db19-85fd-43dc-bb75-347a6d2edd64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df9db19-85fd-43dc-bb75-347a6d2edd64', 'volume_size': 1}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c 1G" returned: 0 in 0.671s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:07 devstack sudo[86616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c
Apr 15 16:31:07 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:07 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c" returned: 0 in 0.516s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:07 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c is being set with open permissions: ugo+rw
Apr 15 16:31:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:07 devstack sudo[86622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c
Apr 15 16:31:07 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:08 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c" returned: 0 in 0.502s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:08 devstack sudo[86625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.info
Apr 15 16:31:08 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:08 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.info" returned: 0 in 0.451s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:08 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.info is being set with open permissions: ugo+rw
Apr 15 16:31:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:08 devstack sudo[86628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.info
Apr 15 16:31:08 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.info" returned: 0 in 0.537s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:09 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.360s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.055s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-43413113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df9db19-85fd-43dc-bb75-347a6d2edd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db93332198c1403f91256c2d9e47ef8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:07Z,use_quota=True,user_id='56eca02eef1347c2af4084fa55f48f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Creating volume 2df9db19-85fd-43dc-bb75-347a6d2edd64 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:09 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:09 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9ddee2c1-c9ec-46e2-b3b4-4d3c54f1ae12 tempest-SnapshotMetadataTestJSON-1047954108 None] Create snapshot completed successfully
Apr 15 16:31:09 devstack sudo[86631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64 1073741824
Apr 15 16:31:09 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:09 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64 1073741824" returned: 0 in 0.616s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:09 devstack sudo[86636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64
Apr 15 16:31:09 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:10 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64" returned: 0 in 0.465s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966dfb73-6950-42da-952e-68ca79a28815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df9db19-85fd-43dc-bb75-347a6d2edd64', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8a6a9e-b6b0-4bea-b4e6-8df1caef8735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:10 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Volume volume-2df9db19-85fd-43dc-bb75-347a6d2edd64 (2df9db19-85fd-43dc-bb75-347a6d2edd64): created successfully
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8a6a9e-b6b0-4bea-b4e6-8df1caef8735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Flow 'volume_create_manager' (ea6b061c-8411-4513-9176-dd17b655058f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:10 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-956f4c2b-e8c0-49cb-948a-ca8a7fdc359a tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Created volume successfully.
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Acquiring lock "cinder-ea589dce-bdb6-4ee1-8309-61a15ccb205c-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-ea589dce-bdb6-4ee1-8309-61a15ccb205c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Acquiring lock "cinder-quobyte-701f4970-6fa3-42f8-af1d-3e6abca582b5" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-quobyte-701f4970-6fa3-42f8-af1d-3e6abca582b5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Acquiring lock "cinder-quobyte-ea589dce-bdb6-4ee1-8309-61a15ccb205c" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-quobyte-ea589dce-bdb6-4ee1-8309-61a15ccb205c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Deleting offline snapshot ea589dce-bdb6-4ee1-8309-61a15ccb205c of volume 701f4970-6fa3-42f8-af1d-3e6abca582b5 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] snapshot_file for this snap is: volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a560f089-e5af-437f-aa4c-e274ef21b86e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:10 devstack sudo[86639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c
Apr 15 16:31:10 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:11 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c" returned: 0 in 0.575s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-701f4970-6fa3-42f8-af1d-3e6abca582b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:31:11 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4086a21-9047-40f5-9138-af7463388057]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:11 devstack sudo[86644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5
Apr 15 16:31:11 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:11 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5" returned: 0 in 0.556s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:11 devstack sudo[86649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c
Apr 15 16:31:11 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Acquiring lock "cinder-2df9db19-85fd-43dc-bb75-347a6d2edd64-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "cinder-2df9db19-85fd-43dc-bb75-347a6d2edd64-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Acquiring lock "cinder-quobyte-2df9db19-85fd-43dc-bb75-347a6d2edd64" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "cinder-quobyte-2df9db19-85fd-43dc-bb75-347a6d2edd64" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3b3356-d991-47df-9b1f-4f14abe3abbc]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:12 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64
Apr 15 16:31:12 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:12 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c" returned: 0 in 0.542s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:12 devstack sudo[86656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c
Apr 15 16:31:12 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:12 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64" returned: 0 in 0.608s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:12 devstack sudo[86662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64
Apr 15 16:31:12 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:12 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5.ea589dce-bdb6-4ee1-8309-61a15ccb205c" returned: 0 in 0.484s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-quobyte-ea589dce-bdb6-4ee1-8309-61a15ccb205c" released by "_delete_snapshot" :: held 2.219s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-quobyte-701f4970-6fa3-42f8-af1d-3e6abca582b5" released by "delete_snapshot" :: held 2.237s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:12 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Created reservations ['6d21d475-c98d-4d27-8432-d9f899233ec2', 'bd3d3592-d788-4f71-b465-17e108c81037', 'f846dae9-e6b6-4c92-a971-c748dea71de2', '61196935-37db-4ec9-b141-4af6ddfcf00b'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:13 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Delete snapshot completed successfully.
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4a1dca8-50f1-40ab-b46a-94a81c27e3b5 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-ea589dce-bdb6-4ee1-8309-61a15ccb205c-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:13 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2df9db19-85fd-43dc-bb75-347a6d2edd64" returned: 0 in 0.516s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "cinder-quobyte-2df9db19-85fd-43dc-bb75-347a6d2edd64" released by "delete_volume" :: held 1.159s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Created reservations ['f7d4eba1-9914-41e5-9705-3cab4ca383c7', 'bafa595f-615b-45c7-a6d9-2b2387147233', 'b24c7eb7-aba1-4cd3-9ed4-aae360a051c6', '492b76e8-1007-4cf7-bad4-4cd481f52c4e'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:13 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:13 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:13 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.444s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:13 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Deleted volume successfully.
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0e528a6f-a8fb-4c13-b193-0126c0836046 tempest-VolumeQuotasNegativeTestJSON-1983995089 None] Lock "cinder-2df9db19-85fd-43dc-bb75-347a6d2edd64-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Acquiring lock "cinder-701f4970-6fa3-42f8-af1d-3e6abca582b5-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-701f4970-6fa3-42f8-af1d-3e6abca582b5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Acquiring lock "cinder-quobyte-701f4970-6fa3-42f8-af1d-3e6abca582b5" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-quobyte-701f4970-6fa3-42f8-af1d-3e6abca582b5" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:14 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[be02a70f-b332-4830-a966-1ac1ca822bed]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:14 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5
Apr 15 16:31:14 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:14 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5" returned: 0 in 0.561s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:14 devstack sudo[86673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5
Apr 15 16:31:14 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:15 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-701f4970-6fa3-42f8-af1d-3e6abca582b5" returned: 0 in 0.495s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-quobyte-701f4970-6fa3-42f8-af1d-3e6abca582b5" released by "delete_volume" :: held 1.089s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Created reservations ['cab55281-9181-411e-b537-e3f2a9dd775d', '2c8d443b-d42f-4a3b-b0c4-061e9c04ecf3', '9d62160b-6793-42a0-a723-d1327b45ac1c', '16db2fbf-b491-4be8-801d-3e5d32ccb3f6'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:15 devstack sudo[86676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:15 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:15 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.490s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Deleted volume successfully.
Apr 15 16:31:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-0d402e92-f6e8-48f6-97ce-9d90354d0808 tempest-SnapshotMetadataTestJSON-1047954108 None] Lock "cinder-701f4970-6fa3-42f8-af1d-3e6abca582b5-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Flow 'volume_create_manager' (0ba3126e-af83-4b4b-aad1-11bf01bcbf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed921818-352b-4331-a5fe-540f3b01f9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed921818-352b-4331-a5fe-540f3b01f9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-649787462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc486cbb41e4e4f81d497141ad8b345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:19Z,use_quota=True,user_id='3a9a387801574bdda1f2789f4e1a0f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430d250f-69c4-4dc7-a2e9-476fef7b91f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430d250f-69c4-4dc7-a2e9-476fef7b91f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd31457-66e7-454f-99bc-1ccf95f10cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd31457-66e7-454f-99bc-1ccf95f10cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06', 'volume_name': 'volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9343e1-2b33-445b-8851-4a0c24993ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9343e1-2b33-445b-8851-4a0c24993ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fc733b-7e8f-447f-9b69-7a76f0ae02ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:18 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Volume dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06', 'volume_size': 1}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-649787462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc486cbb41e4e4f81d497141ad8b345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:19Z,use_quota=True,user_id='3a9a387801574bdda1f2789f4e1a0f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Creating volume dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:18 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:18 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06 1073741824
Apr 15 16:31:18 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Flow 'volume_create_manager' (6cab3d6d-8d7e-46d2-8452-937e94fddc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadb9d54-2768-4986-a2b5-54c99418c5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadb9d54-2768-4986-a2b5-54c99418c5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-234067327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b759c8-0d51-494a-a5f1-f80f10c8c129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e485625888d4ff49ed44e309ba68294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:19Z,use_quota=True,user_id='8b638519bce0426588d4a512cb54e1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f8d273-f014-40e4-bb6e-f0fafc357532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f8d273-f014-40e4-bb6e-f0fafc357532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f5ee60-6822-4610-b72b-72fa4ecd99ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f5ee60-6822-4610-b72b-72fa4ecd99ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b759c8-0d51-494a-a5f1-f80f10c8c129', 'volume_name': 'volume-05b759c8-0d51-494a-a5f1-f80f10c8c129', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff9be41-037a-47b3-92d8-40592d8b04df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff9be41-037a-47b3-92d8-40592d8b04df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b413d161-21d6-4022-aa57-2972acd691d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Volume 05b759c8-0d51-494a-a5f1-f80f10c8c129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b759c8-0d51-494a-a5f1-f80f10c8c129', 'volume_size': 1}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Flow 'volume_create_manager' (1c98268e-0549-4ac6-aef0-ba759f38a5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500e3fc2-e895-4b4c-9d41-ca0fcdc61ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500e3fc2-e895-4b4c-9d41-ca0fcdc61ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2022510328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec235b6a-406f-437b-8455-a8c73996a04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f57c64a1edc47ed98d9aa1c75d57d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:19Z,use_quota=True,user_id='6f814d7bb6bc4dca979744fcc6a1240b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9f618d8-4953-4d59-b0ec-7e025b1f2c53),volume_type_id=f9f618d8-4953-4d59-b0ec-7e025b1f2c53)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc48b7f-eccc-4d5f-b1c8-f78732923ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc48b7f-eccc-4d5f-b1c8-f78732923ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6a570a-b987-4142-bda3-7402b1955818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6a570a-b987-4142-bda3-7402b1955818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec235b6a-406f-437b-8455-a8c73996a04a', 'volume_name': 'volume-ec235b6a-406f-437b-8455-a8c73996a04a', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdda0a2f-2683-48e1-a120-1bfbb8d5af76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdda0a2f-2683-48e1-a120-1bfbb8d5af76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4d67e7-ff7c-43b3-b8b2-b6a83f0bf07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:19 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Volume ec235b6a-406f-437b-8455-a8c73996a04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec235b6a-406f-437b-8455-a8c73996a04a', 'volume_size': 1}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:19 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06 1073741824" returned: 0 in 0.746s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:19 devstack sudo[86686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06
Apr 15 16:31:19 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:20 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06" returned: 0 in 0.499s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-234067327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b759c8-0d51-494a-a5f1-f80f10c8c129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e485625888d4ff49ed44e309ba68294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:19Z,use_quota=True,user_id='8b638519bce0426588d4a512cb54e1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Creating volume 05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:20 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fc733b-7e8f-447f-9b69-7a76f0ae02ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:20 devstack sudo[86689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 1073741824
Apr 15 16:31:20 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9a19a7-88e9-4a81-aa4a-536b61d6342f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:20 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Volume volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06 (dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06): created successfully
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9a19a7-88e9-4a81-aa4a-536b61d6342f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Flow 'volume_create_manager' (0ba3126e-af83-4b4b-aad1-11bf01bcbf9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:20 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-dfc7569a-76e5-4ed3-a3c8-135e4d88aca8 tempest-AbsoluteLimitsTests-1111342001 None] Created volume successfully.
Apr 15 16:31:20 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 1073741824" returned: 0 in 0.544s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:20 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129
Apr 15 16:31:20 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Acquiring lock "cinder-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Lock "cinder-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Acquiring lock "cinder-quobyte-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Lock "cinder-quobyte-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a55db8-e1a0-4a87-81e8-0ad423f96dc2]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:21 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129" returned: 0 in 0.502s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2022510328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec235b6a-406f-437b-8455-a8c73996a04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f57c64a1edc47ed98d9aa1c75d57d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:19Z,use_quota=True,user_id='6f814d7bb6bc4dca979744fcc6a1240b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9f618d8-4953-4d59-b0ec-7e025b1f2c53),volume_type_id=f9f618d8-4953-4d59-b0ec-7e025b1f2c53)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Creating volume ec235b6a-406f-437b-8455-a8c73996a04a {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:21 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b413d161-21d6-4022-aa57-2972acd691d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b759c8-0d51-494a-a5f1-f80f10c8c129', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7002233c-cde4-4b49-a52f-f7e919b51df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:21 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Volume volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 (05b759c8-0d51-494a-a5f1-f80f10c8c129): created successfully
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7002233c-cde4-4b49-a52f-f7e919b51df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Flow 'volume_create_manager' (6cab3d6d-8d7e-46d2-8452-937e94fddc0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:21 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3d641376-cd8b-4226-b5b6-5756087be398 tempest-VolumesDeleteCascade-1957663945 None] Created volume successfully.
Apr 15 16:31:21 devstack sudo[86698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a 1073741824
Apr 15 16:31:21 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:21 devstack sudo[86697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06
Apr 15 16:31:21 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Flow 'volume_create_manager' (1f5b7c2e-7131-4ba7-bafe-a4ed8b2de70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e764bb6-bc25-43e5-a946-00895842dc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e764bb6-bc25-43e5-a946-00895842dc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-192239130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd8b475-c9db-47ee-a284-9f589f4a54ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094387745cf6414bad6564c571a8c8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:21Z,use_quota=True,user_id='7510567965234c9685056d66d6da7073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345b0c79-9696-4895-9fa8-c509fe4db484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345b0c79-9696-4895-9fa8-c509fe4db484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec50336c-021c-4560-96b3-e6be9a7ebce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.image.glance [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Creating Keystone auth plugin from conf {{(pid=82156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec50336c-021c-4560-96b3-e6be9a7ebce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cd8b475-c9db-47ee-a284-9f589f4a54ac', 'volume_name': 'volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8e95dbe20>}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5078d80-4d19-4a8e-a477-821843fab5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5078d80-4d19-4a8e-a477-821843fab5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668e41c7-a0f1-4b3d-b28a-eda641b3ced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:21 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Volume 6cd8b475-c9db-47ee-a284-9f589f4a54ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8e95dbe20>}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Trying to clone 6cd8b475-c9db-47ee-a284-9f589f4a54ac from image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]). {{(pid=82156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 16:31:21 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96ab437-0043-4090-b092-a754b3738ee4]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:21 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06" returned: 0 in 0.622s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:21 devstack sudo[86709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06
Apr 15 16:31:21 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:21 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD
Apr 15 16:31:21 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:21 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a 1073741824" returned: 0 in 0.672s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:21 devstack sudo[86712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a
Apr 15 16:31:21 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:22 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06" returned: 0 in 0.430s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Lock "cinder-quobyte-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06" released by "delete_volume" :: held 1.082s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Created reservations ['dba95179-f8c5-498a-93ac-f8435932a591', '5177c43b-59f5-4bf0-ae17-05cd6e6963d0', '91812009-542b-4cec-a93e-47c770cd3d77', 'deb00194-4671-4817-ae54-e1f33721fd96'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:22 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Temporary image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 is fetched for user 7510567965234c9685056d66d6da7073. {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:22 devstack sudo[86719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:22 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a719ba9-f4fb-4e57-9c50-5ddb1257c96a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:22 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a" returned: 0 in 0.450s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.828s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4d67e7-ff7c-43b3-b8b2-b6a83f0bf07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec235b6a-406f-437b-8455-a8c73996a04a', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7586adbe-a1b1-4a6e-8545-6279aac359cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Creating offline snapshot 79117ef3-5f19-41b1-a59d-1602ddf0687c of volume 05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:31:22 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Volume volume-ec235b6a-406f-437b-8455-a8c73996a04a (ec235b6a-406f-437b-8455-a8c73996a04a): created successfully
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7586adbe-a1b1-4a6e-8545-6279aac359cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:22 devstack sudo[86721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD
Apr 15 16:31:22 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Flow 'volume_create_manager' (1c98268e-0549-4ac6-aef0-ba759f38a5ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d5215d-be30-4d7a-8318-5a5d86713a56]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d0b3270a-f8e2-4e16-a0b8-35d7dca07c6e tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Created volume successfully.
Apr 15 16:31:22 devstack sudo[86723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129
Apr 15 16:31:22 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:22 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.426s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Deleted volume successfully.
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8b5019cf-78ca-46bf-a35d-b17adce5dd58 tempest-AbsoluteLimitsTests-1111342001 None] Lock "cinder-dc1c89b9-02ce-4f88-ad7d-54b4d4dfdb06-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:22 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:22 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129" returned: 0 in 0.493s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:22 devstack sudo[86732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c 1G
Apr 15 16:31:22 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:23 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c 1G" returned: 0 in 0.522s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:23 devstack sudo[86737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c
Apr 15 16:31:23 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb6660be-52dd-4e2c-813a-254fe1d0a813 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb6660be-52dd-4e2c-813a-254fe1d0a813 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb6660be-52dd-4e2c-813a-254fe1d0a813 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb6660be-52dd-4e2c-813a-254fe1d0a813 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb6660be-52dd-4e2c-813a-254fe1d0a813 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb6660be-52dd-4e2c-813a-254fe1d0a813 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:23 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:23 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:23 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c" returned: 0 in 0.489s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:23 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c is being set with open permissions: ugo+rw
Apr 15 16:31:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:23 devstack sudo[86744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c
Apr 15 16:31:23 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:24 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb6660be-52dd-4e2c-813a-254fe1d0a813 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.460s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:24 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-cb6660be-52dd-4e2c-813a-254fe1d0a813 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:24 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cb6660be-52dd-4e2c-813a-254fe1d0a813 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Retype volume completed successfully.
Apr 15 16:31:24 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c" returned: 0 in 0.471s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:24 devstack sudo[86749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.info
Apr 15 16:31:24 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:24 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.info" returned: 0 in 0.464s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:24 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.info is being set with open permissions: ugo+rw
Apr 15 16:31:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:24 devstack sudo[86752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.info
Apr 15 16:31:24 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Acquiring lock "cinder-ec235b6a-406f-437b-8455-a8c73996a04a-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "cinder-ec235b6a-406f-437b-8455-a8c73996a04a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Acquiring lock "cinder-quobyte-ec235b6a-406f-437b-8455-a8c73996a04a" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "cinder-quobyte-ec235b6a-406f-437b-8455-a8c73996a04a" acquired by "delete_volume" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3272c32a-c8e7-427e-bde1-23abee278697]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:25 devstack sudo[86754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a
Apr 15 16:31:25 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:25 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.info" returned: 0 in 0.477s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.549s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-192239130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd8b475-c9db-47ee-a284-9f589f4a54ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094387745cf6414bad6564c571a8c8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:21Z,use_quota=True,user_id='7510567965234c9685056d66d6da7073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Creating volume 6cd8b475-c9db-47ee-a284-9f589f4a54ac {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:25 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:25 devstack sudo[86757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac 1073741824
Apr 15 16:31:25 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:25 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1f89b134-54f3-4344-bb8b-6fa7815c7ddc tempest-VolumesDeleteCascade-1957663945 None] Create snapshot completed successfully
Apr 15 16:31:25 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a" returned: 0 in 0.540s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:25 devstack sudo[86762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a
Apr 15 16:31:25 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:26 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac 1073741824" returned: 0 in 0.571s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:26 devstack sudo[86767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac
Apr 15 16:31:26 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:26 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ec235b6a-406f-437b-8455-a8c73996a04a" returned: 0 in 0.451s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "cinder-quobyte-ec235b6a-406f-437b-8455-a8c73996a04a" released by "delete_volume" :: held 1.016s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:26 devstack cinder-volume[82156]: WARNING cinder.quota [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:31:26 devstack cinder-volume[82156]: WARNING cinder.quota [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Created reservations ['e0fed454-9c51-4603-972e-ea1144fe0e73', '72785934-d452-45cb-b8ff-2bdb12929eb6', 'fc816636-2b24-4435-a2ad-5e651216fd84', '7993d946-26c8-4a01-9968-b98b59ecaeb0'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:26 devstack sudo[86770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:26 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:26 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac" returned: 0 in 0.510s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.708s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Creating offline snapshot 735323a0-a08c-40fe-b7c2-289897d7092f of volume 05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[465c6dc3-f75c-48da-a909-8d7f104d36a4]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Attempting download of 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}])) to volume 6cd8b475-c9db-47ee-a284-9f589f4a54ac. {{(pid=82156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31fac7f-d8f1-4f74-aef7-bdf757101077]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_kjiep13t {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:26 devstack sudo[86773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c
Apr 15 16:31:26 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Flow 'volume_create_manager' (e8cc4ec5-6504-4a25-9b67-2bc026a1877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f86e20-31aa-4d78-9c98-efc68a2d8733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:26 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f86e20-31aa-4d78-9c98-efc68a2d8733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-12082475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72206d10-ee18-42dc-ba79-3899e4eb688b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9c0b1717fd452c8b9ad260db317ec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:27Z,use_quota=True,user_id='b6b283cfa8f84c4184b9700c1b49c541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6096f29-586f-4cc5-abfa-38e483e1cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6096f29-586f-4cc5-abfa-38e483e1cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e2f704-554c-488a-b4fd-670ec765c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e2f704-554c-488a-b4fd-670ec765c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72206d10-ee18-42dc-ba79-3899e4eb688b', 'volume_name': 'volume-72206d10-ee18-42dc-ba79-3899e4eb688b', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f96d724-60d8-431a-861e-bab954ac8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:26 devstack sudo[86775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_kjiep13t
Apr 15 16:31:26 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f96d724-60d8-431a-861e-bab954ac8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8bb249-6e6b-4342-8d02-6c594fde403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:26 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Volume 72206d10-ee18-42dc-ba79-3899e4eb688b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72206d10-ee18-42dc-ba79-3899e4eb688b', 'volume_size': 1}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.506s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:26 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Deleted volume successfully.
Apr 15 16:31:26 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-132b26d3-6688-4530-ad97-c96c345d8b83 tempest-VolumeRetypeWithoutMigrationTest-1518765608 None] Lock "cinder-ec235b6a-406f-437b-8455-a8c73996a04a-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:27 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c" returned: 0 in 0.521s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b759c8-0d51-494a-a5f1-f80f10c8c129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:27 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_kjiep13t" returned: 0 in 0.471s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_kjiep13t {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:27 devstack sudo[86783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f 1G
Apr 15 16:31:27 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:27 devstack sudo[86784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_kjiep13t
Apr 15 16:31:27 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:27 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_kjiep13t" returned: 1 in 0.528s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_kjiep13t' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7648807a-9c9f-4557-a464-7e3e56111382]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:27 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f 1G" returned: 0 in 0.551s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:27 devstack sudo[86794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f
Apr 15 16:31:27 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:27 devstack sudo[86793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD
Apr 15 16:31:27 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:28 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f" returned: 0 in 0.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:28 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f is being set with open permissions: ugo+rw
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:28 devstack sudo[86803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f
Apr 15 16:31:28 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:28 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 was qcow2, converting to raw {{(pid=82156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:28 devstack sudo[86805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac
Apr 15 16:31:28 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:28 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f" returned: 0 in 0.464s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-12082475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72206d10-ee18-42dc-ba79-3899e4eb688b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9c0b1717fd452c8b9ad260db317ec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:27Z,use_quota=True,user_id='b6b283cfa8f84c4184b9700c1b49c541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Creating volume 72206d10-ee18-42dc-ba79-3899e4eb688b {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:28 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:28 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-f62ae984-9b1c-4caa-9e33-c3052e8b0c6e tempest-VolumesDeleteCascade-1957663945 None] Create snapshot completed successfully
Apr 15 16:31:28 devstack sudo[86811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b 1073741824
Apr 15 16:31:28 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-05b759c8-0d51-494a-a5f1-f80f10c8c129-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-05b759c8-0d51-494a-a5f1-f80f10c8c129-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Performing cascade delete. {{(pid=82156) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-735323a0-a08c-40fe-b7c2-289897d7092f-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-735323a0-a08c-40fe-b7c2-289897d7092f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-05b759c8-0d51-494a-a5f1-f80f10c8c129" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-05b759c8-0d51-494a-a5f1-f80f10c8c129" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-735323a0-a08c-40fe-b7c2-289897d7092f" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-735323a0-a08c-40fe-b7c2-289897d7092f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Deleting offline snapshot 735323a0-a08c-40fe-b7c2-289897d7092f of volume 05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] snapshot_file for this snap is: volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21d214e-8648-43ac-af03-b64f0352c47b]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:29 devstack sudo[86832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f
Apr 15 16:31:29 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:29 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac" returned: 0 in 1.090s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_31gyufuydevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:31:29 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Converted 112.00 MB image at 102.68 MB/s
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:29 devstack sudo[86837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac 1G
Apr 15 16:31:29 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:29 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b 1073741824" returned: 0 in 0.713s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:29 devstack sudo[86839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b
Apr 15 16:31:29 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:29 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f" returned: 0 in 0.587s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b759c8-0d51-494a-a5f1-f80f10c8c129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c3105-88fb-4db8-8319-e8b7b24a3b8c]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:29 devstack sudo[86847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c
Apr 15 16:31:29 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:29 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac 1G" returned: 0 in 0.562s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f2381c-763b-44f9-89d3-1a6de7133ea3]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:29 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b" returned: 0 in 0.510s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8bb249-6e6b-4342-8d02-6c594fde403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72206d10-ee18-42dc-ba79-3899e4eb688b', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5574698a-2e76-43ff-87d5-44994d9e9282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:29 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Volume volume-72206d10-ee18-42dc-ba79-3899e4eb688b (72206d10-ee18-42dc-ba79-3899e4eb688b): created successfully
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5574698a-2e76-43ff-87d5-44994d9e9282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Flow 'volume_create_manager' (e8cc4ec5-6504-4a25-9b67-2bc026a1877f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:29 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1ba41521-1144-4cbb-a05e-16ee98fbdd87 tempest-VolumesTransfersTest-261556438 None] Created volume successfully.
Apr 15 16:31:29 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac
Apr 15 16:31:29 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:30 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c" returned: 0 in 0.580s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b759c8-0d51-494a-a5f1-f80f10c8c129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:30 devstack sudo[86856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f
Apr 15 16:31:30 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:30 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Flow 'volume_create_manager' (bcd3b41c-c6b6-4d7d-9bb3-cae524c12e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7041d7c7-91cd-40c5-b82f-0f7da9beef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac" returned: 0 in 0.558s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7041d7c7-91cd-40c5-b82f-0f7da9beef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1341326002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aab8b40-de34-42dc-93c4-99ce4dec3bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99756b1e088a4b739ab41ecc5e2cff38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:30Z,use_quota=True,user_id='f53f484846b64010ad83090d318da1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e968d69d-0fe7-4afc-bda4-7edd3dcabc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e968d69d-0fe7-4afc-bda4-7edd3dcabc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f319bd0f-3b53-43a3-8cdb-0ffcde9e0b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f319bd0f-3b53-43a3-8cdb-0ffcde9e0b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aab8b40-de34-42dc-93c4-99ce4dec3bc3', 'volume_name': 'volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d7b873-74e9-411c-988c-8de43cc4f19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d7b873-74e9-411c-988c-8de43cc4f19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0eacdc8-0ca4-4aad-99b3-4b5534fec48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Volume 4aab8b40-de34-42dc-93c4-99ce4dec3bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3', 'volume_size': 1}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1341326002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aab8b40-de34-42dc-93c4-99ce4dec3bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99756b1e088a4b739ab41ecc5e2cff38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:30Z,use_quota=True,user_id='f53f484846b64010ad83090d318da1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Creating volume 4aab8b40-de34-42dc-93c4-99ce4dec3bc3 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:30 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:30 devstack sudo[86859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac
Apr 15 16:31:30 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:30 devstack sudo[86860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3 1073741824
Apr 15 16:31:30 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:30 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f" returned: 0 in 0.499s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:30 devstack sudo[86866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f
Apr 15 16:31:30 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:31 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac" returned: 1 in 0.538s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Downloaded image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}])) to volume 6cd8b475-c9db-47ee-a284-9f589f4a54ac successfully. {{(pid=82156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Temporary image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 for user 7510567965234c9685056d66d6da7073 is deleted. {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Marking volume 6cd8b475-c9db-47ee-a284-9f589f4a54ac as bootable. {{(pid=82156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Copying metadata from image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 to 6cd8b475-c9db-47ee-a284-9f589f4a54ac. {{(pid=82156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Creating volume glance metadata for volume 6cd8b475-c9db-47ee-a284-9f589f4a54ac backed by image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668e41c7-a0f1-4b3d-b28a-eda641b3ced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8e95dbe20>}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c289314-7d48-4d92-a2d7-dfbfe7523bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:31 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Volume volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac (6cd8b475-c9db-47ee-a284-9f589f4a54ac): created successfully
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c289314-7d48-4d92-a2d7-dfbfe7523bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Flow 'volume_create_manager' (1f5b7c2e-7131-4ba7-bafe-a4ed8b2de70f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1f0dedc8-6942-430f-935b-2f6eac776e48 tempest-VolumesImageMetadata-292272322 None] Created volume successfully.
Apr 15 16:31:31 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3 1073741824" returned: 0 in 0.616s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:31 devstack sudo[86874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3
Apr 15 16:31:31 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-4dea56bd-30e5-4f89-82ef-3cbe606d4ad4 tempest-VolumesTransfersTest-329642864 None] Transfer volume completed successfully.
Apr 15 16:31:31 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.735323a0-a08c-40fe-b7c2-289897d7092f" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-735323a0-a08c-40fe-b7c2-289897d7092f" released by "_delete_snapshot" :: held 2.185s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-05b759c8-0d51-494a-a5f1-f80f10c8c129" released by "delete_snapshot" :: held 2.202s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Created reservations ['626af8fe-ac4c-4554-8360-ddc8b3969234', 'f306d592-2078-4038-a865-f027f1b7248f', 'cfabc43e-02ab-40eb-b825-1b715a714c3f', '28d6e3e3-2f26-4074-8976-e1a10225cfea'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Delete snapshot completed successfully.
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-735323a0-a08c-40fe-b7c2-289897d7092f-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-79117ef3-5f19-41b1-a59d-1602ddf0687c-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-79117ef3-5f19-41b1-a59d-1602ddf0687c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-05b759c8-0d51-494a-a5f1-f80f10c8c129" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-05b759c8-0d51-494a-a5f1-f80f10c8c129" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-79117ef3-5f19-41b1-a59d-1602ddf0687c" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-79117ef3-5f19-41b1-a59d-1602ddf0687c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Deleting offline snapshot 79117ef3-5f19-41b1-a59d-1602ddf0687c of volume 05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] snapshot_file for this snap is: volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181f948-82a1-4527-a3e3-fd782c762a6b]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:31 devstack sudo[86877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c
Apr 15 16:31:31 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:31 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3" returned: 0 in 0.484s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0eacdc8-0ca4-4aad-99b3-4b5534fec48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d23ec0-cc43-4a22-84f2-4238e44b868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:31 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Volume volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3 (4aab8b40-de34-42dc-93c4-99ce4dec3bc3): created successfully
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d23ec0-cc43-4a22-84f2-4238e44b868d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Flow 'volume_create_manager' (bcd3b41c-c6b6-4d7d-9bb3-cae524c12e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-bace687e-fa49-4244-bf91-3f55dd093a8a tempest-VolumesServicesTestJSON-1045150556 None] Created volume successfully.
Apr 15 16:31:32 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c" returned: 0 in 0.540s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b759c8-0d51-494a-a5f1-f80f10c8c129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[837d226e-7b7d-4ed6-86cd-494deefadc49]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Acquiring lock "cinder-6cd8b475-c9db-47ee-a284-9f589f4a54ac-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Lock "cinder-6cd8b475-c9db-47ee-a284-9f589f4a54ac-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:32 devstack sudo[86883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129
Apr 15 16:31:32 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Acquiring lock "cinder-quobyte-6cd8b475-c9db-47ee-a284-9f589f4a54ac" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Lock "cinder-quobyte-6cd8b475-c9db-47ee-a284-9f589f4a54ac" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[16908499-48e9-417a-aeb2-34df06bad885]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Acquiring lock "cinder-72206d10-ee18-42dc-ba79-3899e4eb688b-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Lock "cinder-72206d10-ee18-42dc-ba79-3899e4eb688b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Acquiring lock "cinder-quobyte-72206d10-ee18-42dc-ba79-3899e4eb688b" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Lock "cinder-quobyte-72206d10-ee18-42dc-ba79-3899e4eb688b" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:32 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac
Apr 15 16:31:32 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a192755f-1a84-4202-b715-09859e513d20]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:32 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b
Apr 15 16:31:32 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:32 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129" returned: 0 in 0.558s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:32 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c
Apr 15 16:31:32 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Acquiring lock "cinder-4aab8b40-de34-42dc-93c4-99ce4dec3bc3-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Lock "cinder-4aab8b40-de34-42dc-93c4-99ce4dec3bc3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Acquiring lock "cinder-quobyte-4aab8b40-de34-42dc-93c4-99ce4dec3bc3" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:32 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac" returned: 0 in 0.550s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Lock "cinder-quobyte-4aab8b40-de34-42dc-93c4-99ce4dec3bc3" acquired by "delete_volume" :: waited 0.030s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b879bc35-d85c-45a8-a098-5e7c070f97a4]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:32 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b" returned: 0 in 0.540s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:32 devstack sudo[86899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac
Apr 15 16:31:32 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:32 devstack sudo[86902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b
Apr 15 16:31:32 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:32 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3
Apr 15 16:31:32 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:33 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c" returned: 0 in 0.494s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:33 devstack sudo[86908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c
Apr 15 16:31:33 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:33 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac" returned: 1 in 0.517s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:33 devstack sudo[86917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac
Apr 15 16:31:33 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:33 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-72206d10-ee18-42dc-ba79-3899e4eb688b" returned: 0 in 0.487s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Lock "cinder-quobyte-72206d10-ee18-42dc-ba79-3899e4eb688b" released by "delete_volume" :: held 1.048s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:33 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3" returned: 0 in 0.554s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:33 devstack sudo[86919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3
Apr 15 16:31:33 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Created reservations ['ba318996-bf28-4d70-a72a-51e06e548788', 'cd662179-28eb-435e-81d8-18b0ae33eaf5', 'a6a5a287-8e7e-4e0b-9070-13df549d9264', '148d424f-8412-4dd0-8866-4bcc8ff22c7c'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:33 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:33 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:33 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129.79117ef3-5f19-41b1-a59d-1602ddf0687c" returned: 0 in 0.431s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-79117ef3-5f19-41b1-a59d-1602ddf0687c" released by "_delete_snapshot" :: held 2.077s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-05b759c8-0d51-494a-a5f1-f80f10c8c129" released by "delete_snapshot" :: held 2.087s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Created reservations ['c141257a-cb95-4052-8960-1a0a1667a573', '6f3f1658-7af0-49a4-bff8-1d1cefda1342', 'f59401fe-5be0-45e7-9121-d50e9c997ede', '334cb0c7-2223-4ff6-913a-cf2cefc017ba'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:33 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Delete snapshot completed successfully.
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-79117ef3-5f19-41b1-a59d-1602ddf0687c-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Snapshots deleted, issuing volume delete {{(pid=82156) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-05b759c8-0d51-494a-a5f1-f80f10c8c129" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-05b759c8-0d51-494a-a5f1-f80f10c8c129" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2136184-087c-467a-b7c4-4f718aa18df2]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:33 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6cd8b475-c9db-47ee-a284-9f589f4a54ac" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:33 devstack sudo[86925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129
Apr 15 16:31:33 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Lock "cinder-quobyte-6cd8b475-c9db-47ee-a284-9f589f4a54ac" released by "delete_volume" :: held 1.577s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Created reservations ['11f0acb0-3fe6-4db3-8d9c-b23ff5fdd62c', '23207d41-7692-48b7-8511-56ae94f4ccf9', '7c1d8a7b-97a2-4a85-b5dc-61767a24694f', 'e6c32add-84dd-436a-a0ac-ea257eb5f1de'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:33 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4aab8b40-de34-42dc-93c4-99ce4dec3bc3" returned: 0 in 0.466s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Lock "cinder-quobyte-4aab8b40-de34-42dc-93c4-99ce4dec3bc3" released by "delete_volume" :: held 1.044s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:33 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:33 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Created reservations ['ece35427-5b43-4ff8-8c17-35f3c8179e26', '32d1414b-19fd-4bf0-b3d4-50b2e06dc2f3', '233f1cf0-ab7c-4663-a43a-3f4ccb1c7718', 'ea0d30d8-b3a0-489d-a78d-92c36a57a975'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:33 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.496s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:33 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Deleted volume successfully.
Apr 15 16:31:33 devstack sudo[86931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:33 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-005c550f-c4c3-42db-bb5b-1ea395688aa7 tempest-VolumesTransfersTest-1993632857 None] Lock "cinder-72206d10-ee18-42dc-ba79-3899e4eb688b-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:34 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129" returned: 0 in 0.509s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:34 devstack sudo[86936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129
Apr 15 16:31:34 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:34 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.469s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:34 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Deleted volume successfully.
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6d9babdf-ca43-4785-bb21-8b239cb8e765 tempest-VolumesImageMetadata-292272322 None] Lock "cinder-6cd8b475-c9db-47ee-a284-9f589f4a54ac-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:34 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.436s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:34 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Deleted volume successfully.
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-59f36eb3-15f6-4775-86b5-3b1949409a7b tempest-VolumesServicesTestJSON-1045150556 None] Lock "cinder-4aab8b40-de34-42dc-93c4-99ce4dec3bc3-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:34 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-05b759c8-0d51-494a-a5f1-f80f10c8c129" returned: 0 in 0.516s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-05b759c8-0d51-494a-a5f1-f80f10c8c129" released by "delete_volume" :: held 1.055s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Created reservations ['31d77103-0cc0-401e-89b7-41e8e8b03627', 'f8abfd91-ffa0-49ef-8c8b-1cef894033bd', '7d0e674a-d38b-4b0f-ba6f-9093e5d49b7b', '406645a1-d497-489c-a54f-063a75fa7f1e'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Flow 'volume_create_manager' (a221a389-cbbb-4c84-b665-c98ac91edc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9ac72-4a83-414f-af40-99cf9a8167f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:34 devstack sudo[86975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:34 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9ac72-4a83-414f-af40-99cf9a8167f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1487066926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ef6b24-2a8e-4c18-ab72-dd45bae40249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9c0b1717fd452c8b9ad260db317ec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:35Z,use_quota=True,user_id='b6b283cfa8f84c4184b9700c1b49c541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fef43d4-fcc6-4e91-8056-28749afb3d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fef43d4-fcc6-4e91-8056-28749afb3d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e0a353-8ba5-498a-9717-9539e439ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e0a353-8ba5-498a-9717-9539e439ca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ef6b24-2a8e-4c18-ab72-dd45bae40249', 'volume_name': 'volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e69004-2d9e-44ed-87c7-1dc365ea005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e69004-2d9e-44ed-87c7-1dc365ea005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cb6289-fe67-44d2-9009-923df607f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:34 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Volume 31ef6b24-2a8e-4c18-ab72-dd45bae40249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249', 'volume_size': 1}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1487066926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ef6b24-2a8e-4c18-ab72-dd45bae40249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9c0b1717fd452c8b9ad260db317ec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:35Z,use_quota=True,user_id='b6b283cfa8f84c4184b9700c1b49c541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Creating volume 31ef6b24-2a8e-4c18-ab72-dd45bae40249 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:34 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:34 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249 1073741824
Apr 15 16:31:34 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:35 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:35 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:35 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Deleted volume successfully.
Apr 15 16:31:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-daa31420-55f6-47fb-87d2-75771a380484 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-05b759c8-0d51-494a-a5f1-f80f10c8c129-delete_volume" released by "delete_volume" :: held 6.316s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:35 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249 1073741824" returned: 0 in 0.642s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:35 devstack sudo[86983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249
Apr 15 16:31:35 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:35 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Flow 'volume_create_manager' (526657ef-897a-4fc7-bf5f-a203aae250c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b1f393-3da0-4858-8a2f-cf14aebec019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b1f393-3da0-4858-8a2f-cf14aebec019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-808222961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caeba77a-77d5-4af6-9653-54260c1bfc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e485625888d4ff49ed44e309ba68294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:36Z,use_quota=True,user_id='8b638519bce0426588d4a512cb54e1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29a29fb-f376-4ada-9e23-6bf3ce3b64ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29a29fb-f376-4ada-9e23-6bf3ce3b64ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6cc68d-884d-4075-9069-566ce11cd79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6cc68d-884d-4075-9069-566ce11cd79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caeba77a-77d5-4af6-9653-54260c1bfc0c', 'volume_name': 'volume-caeba77a-77d5-4af6-9653-54260c1bfc0c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee9dce3-0bce-4f08-8e14-5bf6fa2e48cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee9dce3-0bce-4f08-8e14-5bf6fa2e48cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7780e46-dfe9-4d71-8012-028e347e674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Volume caeba77a-77d5-4af6-9653-54260c1bfc0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caeba77a-77d5-4af6-9653-54260c1bfc0c', 'volume_size': 1}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:36 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249" returned: 0 in 0.571s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-808222961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caeba77a-77d5-4af6-9653-54260c1bfc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e485625888d4ff49ed44e309ba68294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:36Z,use_quota=True,user_id='8b638519bce0426588d4a512cb54e1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Creating volume caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:36 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cb6289-fe67-44d2-9009-923df607f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b93a43-5cba-4759-8885-21ae868e8859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Volume volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249 (31ef6b24-2a8e-4c18-ab72-dd45bae40249): created successfully
Apr 15 16:31:36 devstack sudo[86986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c 1073741824
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b93a43-5cba-4759-8885-21ae868e8859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Flow 'volume_create_manager' (a221a389-cbbb-4c84-b665-c98ac91edc0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:36 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1acdad52-7d8e-4070-aa54-264b43090a04 tempest-VolumesTransfersTest-261556438 None] Created volume successfully.
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Flow 'volume_create_manager' (9421adfc-7611-41c2-881a-31aefda7faa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ec827a-7a56-4688-b446-5cd2289f58ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ec827a-7a56-4688-b446-5cd2289f58ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1091806768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc8f242-d0a9-4c50-b4ad-85f1e66a3938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fa472cea2c46d9aef0b0bdbf541283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:36Z,use_quota=True,user_id='c1d54e06df6a456d856fd4c6c15fd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c861c17d-f926-425f-91f1-5085329d3aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c861c17d-f926-425f-91f1-5085329d3aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f996950-ab54-4436-8284-935889051cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f996950-ab54-4436-8284-935889051cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc8f242-d0a9-4c50-b4ad-85f1e66a3938', 'volume_name': 'volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58ecc8b-479f-483d-b627-c49651dd3ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58ecc8b-479f-483d-b627-c49651dd3ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd79bbc8-ac8b-4230-8778-787ed7c4bb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:36 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Volume fbc8f242-d0a9-4c50-b4ad-85f1e66a3938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938', 'volume_size': 1}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:36 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c 1073741824" returned: 0 in 0.557s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:36 devstack sudo[86991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c
Apr 15 16:31:36 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Acquiring lock "cinder-31ef6b24-2a8e-4c18-ab72-dd45bae40249-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Lock "cinder-31ef6b24-2a8e-4c18-ab72-dd45bae40249-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Acquiring lock "cinder-quobyte-31ef6b24-2a8e-4c18-ab72-dd45bae40249" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Lock "cinder-quobyte-31ef6b24-2a8e-4c18-ab72-dd45bae40249" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e5123b-e9e2-4fee-bba9-0ffc561ef3e4]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:37 devstack sudo[86994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249
Apr 15 16:31:37 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:37 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c" returned: 0 in 0.551s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1091806768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc8f242-d0a9-4c50-b4ad-85f1e66a3938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fa472cea2c46d9aef0b0bdbf541283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:36Z,use_quota=True,user_id='c1d54e06df6a456d856fd4c6c15fd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Creating volume fbc8f242-d0a9-4c50-b4ad-85f1e66a3938 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:37 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7780e46-dfe9-4d71-8012-028e347e674b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caeba77a-77d5-4af6-9653-54260c1bfc0c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539a55bc-6162-4d8d-a143-a56d416cfa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:37 devstack sudo[86996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938 1073741824
Apr 15 16:31:37 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:37 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Volume volume-caeba77a-77d5-4af6-9653-54260c1bfc0c (caeba77a-77d5-4af6-9653-54260c1bfc0c): created successfully
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539a55bc-6162-4d8d-a143-a56d416cfa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Flow 'volume_create_manager' (526657ef-897a-4fc7-bf5f-a203aae250c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-953822f8-3356-494e-9eb9-cee299258b5b tempest-VolumesDeleteCascade-1957663945 None] Created volume successfully.
Apr 15 16:31:37 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249" returned: 0 in 0.585s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:37 devstack sudo[87005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249
Apr 15 16:31:37 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:37 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938 1073741824" returned: 0 in 0.547s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:37 devstack sudo[87007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938
Apr 15 16:31:37 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:38 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-31ef6b24-2a8e-4c18-ab72-dd45bae40249" returned: 0 in 0.457s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Lock "cinder-quobyte-31ef6b24-2a8e-4c18-ab72-dd45bae40249" released by "delete_volume" :: held 1.080s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Created reservations ['c75eb79b-d16e-4021-9856-e453a04fe3d4', '9ba93521-1484-4d3a-a692-db7216ddd35e', 'bd1dc64e-780c-4f97-9139-afa7346ecf46', 'f57f88f5-c06f-4706-8a26-b14d521555e1'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:38 devstack sudo[87011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:38 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:38 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938" returned: 0 in 0.556s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.256s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Creating offline snapshot bd5e106e-f520-44c9-8778-5c69bab0902d of volume caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd79bbc8-ac8b-4230-8778-787ed7c4bb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccec1a96-e8a4-4387-bbb2-1349a5d27509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d47246-1627-4d4d-8e53-bf559fcc76d6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:38 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Volume volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938 (fbc8f242-d0a9-4c50-b4ad-85f1e66a3938): created successfully
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccec1a96-e8a4-4387-bbb2-1349a5d27509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Flow 'volume_create_manager' (9421adfc-7611-41c2-881a-31aefda7faa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:38 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b4d81c1d-82f4-465c-abf2-d771b1f69b4f tempest-VolumesMetadataTest-1094456376 None] Created volume successfully.
Apr 15 16:31:38 devstack sudo[87013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c
Apr 15 16:31:38 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:38 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.433s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:38 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Deleted volume successfully.
Apr 15 16:31:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-651a6b9b-4461-4173-87e2-325cc79c6319 tempest-VolumesTransfersTest-1993632857 None] Lock "cinder-31ef6b24-2a8e-4c18-ab72-dd45bae40249-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:39 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c" returned: 0 in 0.552s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:39 devstack sudo[87019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d 1G
Apr 15 16:31:39 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:39 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d 1G" returned: 0 in 0.527s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caeba77a-77d5-4af6-9653-54260c1bfc0c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:39 devstack sudo[87024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caeba77a-77d5-4af6-9653-54260c1bfc0c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d
Apr 15 16:31:39 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Acquiring lock "cinder-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Lock "cinder-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Acquiring lock "cinder-quobyte-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Lock "cinder-quobyte-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6ae786-5b91-4274-b9e1-22946d9e4a23]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:40 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caeba77a-77d5-4af6-9653-54260c1bfc0c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d" returned: 0 in 0.580s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:40 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d is being set with open permissions: ugo+rw
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:40 devstack sudo[87030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d
Apr 15 16:31:40 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:40 devstack sudo[87029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938
Apr 15 16:31:40 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Flow 'volume_create_manager' (184986ae-bd47-4c00-a946-bff0809ffc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf23425-1c54-4c21-94fb-591c0d473742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf23425-1c54-4c21-94fb-591c0d473742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-205201923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58333965-7080-4668-a671-23d0a03ed9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05ccb111aae493fad2f05a72ff63554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:40Z,use_quota=True,user_id='e4010608c6464dd49687ae5dc4a80c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd1792c-52e3-4e9b-bf5b-b80e8acbbf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd1792c-52e3-4e9b-bf5b-b80e8acbbf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ccfb24-39db-4b76-b279-8b320c43102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ccfb24-39db-4b76-b279-8b320c43102e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58333965-7080-4668-a671-23d0a03ed9ed', 'volume_name': 'volume-58333965-7080-4668-a671-23d0a03ed9ed', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb89f45-89c0-45ed-a274-87569ca3eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb89f45-89c0-45ed-a274-87569ca3eae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc37832e-7224-4e70-bf6a-bcf720641f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Volume 58333965-7080-4668-a671-23d0a03ed9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58333965-7080-4668-a671-23d0a03ed9ed', 'volume_size': 1}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:40 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938" returned: 0 in 0.570s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:40 devstack sudo[87037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938
Apr 15 16:31:40 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:40 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d" returned: 0 in 0.550s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:40 devstack sudo[87039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.info
Apr 15 16:31:40 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:41 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938" returned: 0 in 0.440s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Lock "cinder-quobyte-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938" released by "delete_volume" :: held 1.038s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Created reservations ['ef6da9c0-0107-41cb-b596-bbacc31b0872', '1d888f31-e5b3-476d-abfe-fade7ca98146', 'ea67fdc2-d36a-442b-b313-1a7d633f387f', 'b60e92f5-7698-424b-9562-d696eb64729c'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:41 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.info" returned: 0 in 0.463s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:41 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.info is being set with open permissions: ugo+rw
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:41 devstack sudo[87043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.info
Apr 15 16:31:41 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:41 devstack sudo[87045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:41 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:41 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.424s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:41 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:41 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Deleted volume successfully.
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.info" returned: 0 in 0.490s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.233s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-205201923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58333965-7080-4668-a671-23d0a03ed9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05ccb111aae493fad2f05a72ff63554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:40Z,use_quota=True,user_id='e4010608c6464dd49687ae5dc4a80c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Creating volume 58333965-7080-4668-a671-23d0a03ed9ed {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:41 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:41 devstack sudo[87049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed 1073741824
Apr 15 16:31:41 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:41 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2e3b9e15-5b00-4dce-a135-c49a626b8ddb tempest-VolumesDeleteCascade-1957663945 None] Create snapshot completed successfully
Apr 15 16:31:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ca384063-1231-48f0-84fc-1d51bc789762 tempest-VolumesMetadataTest-1094456376 None] Lock "cinder-fbc8f242-d0a9-4c50-b4ad-85f1e66a3938-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:42 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed 1073741824" returned: 0 in 0.521s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:42 devstack sudo[87054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed
Apr 15 16:31:42 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Flow 'volume_create_manager' (68da39f8-4187-4268-b547-9e558eb3db06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebee632-18d1-4831-ad18-fd6d729d80f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebee632-18d1-4831-ad18-fd6d729d80f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2032532567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618d39e8-0153-450e-b722-3a6280437ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e485625888d4ff49ed44e309ba68294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd5e106e-f520-44c9-8778-5c69bab0902d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:43Z,use_quota=True,user_id='8b638519bce0426588d4a512cb54e1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e910c62c-ef4e-44cb-a24f-ddd96371e31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e910c62c-ef4e-44cb-a24f-ddd96371e31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72699658-ecdc-48bb-b475-34a1be42115a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72699658-ecdc-48bb-b475-34a1be42115a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '618d39e8-0153-450e-b722-3a6280437ca6', 'volume_name': 'volume-618d39e8-0153-450e-b722-3a6280437ca6', 'volume_size': 1, 'snapshot_id': 'bd5e106e-f520-44c9-8778-5c69bab0902d'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6b81d8-4415-4ceb-bb5a-731c1fce57f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6b81d8-4415-4ceb-bb5a-731c1fce57f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8675428-773b-4436-8d4c-7d8fb9adef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:42 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Volume 618d39e8-0153-450e-b722-3a6280437ca6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-618d39e8-0153-450e-b722-3a6280437ca6', 'volume_size': 1, 'snapshot_id': 'bd5e106e-f520-44c9-8778-5c69bab0902d'}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:42 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed" returned: 0 in 0.599s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.048s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-bd5e106e-f520-44c9-8778-5c69bab0902d-618d39e8-0153-450e-b722-3a6280437ca6" by "_create_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc37832e-7224-4e70-bf6a-bcf720641f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58333965-7080-4668-a671-23d0a03ed9ed', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8773e32c-77a4-46c8-8093-c145edcc4597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:42 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Volume volume-58333965-7080-4668-a671-23d0a03ed9ed (58333965-7080-4668-a671-23d0a03ed9ed): created successfully
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8773e32c-77a4-46c8-8093-c145edcc4597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Flow 'volume_create_manager' (184986ae-bd47-4c00-a946-bff0809ffc56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-bd5e106e-f520-44c9-8778-5c69bab0902d-618d39e8-0153-450e-b722-3a6280437ca6" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Creating volume 618d39e8-0153-450e-b722-3a6280437ca6 from snapshot bd5e106e-f520-44c9-8778-5c69bab0902d {{(pid=82156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-618d39e8-0153-450e-b722-3a6280437ca6" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:42 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ea38893a-7f8a-4d1e-ad66-44319589a04f tempest-VolumesTransfersV357Test-1989870037 None] Created volume successfully.
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-618d39e8-0153-450e-b722-3a6280437ca6" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] snapshot: bd5e106e-f520-44c9-8778-5c69bab0902d, volume: 618d39e8-0153-450e-b722-3a6280437ca6,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad9c6c7-8956-4868-8d70-08f2bb7ea15e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:43 devstack sudo[87057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d
Apr 15 16:31:43 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:43 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d" returned: 0 in 0.561s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caeba77a-77d5-4af6-9653-54260c1bfc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:31:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:31:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:31:43 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c5c5ca-c8ed-4079-b52c-3536377cf881]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:43 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c
Apr 15 16:31:43 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1d5fb3d7-73b8-4ae2-a115-903ffd72a6ea tempest-VolumesTransfersV357Test-37958302 None] Transfer volume completed successfully.
Apr 15 16:31:44 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c" returned: 0 in 0.609s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:44 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:31:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:44 devstack sudo[87067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6
Apr 15 16:31:44 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (c26b2fa6-bcb5-4edd-bb2d-c00524fa722b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e16c32-3cab-41d0-a997-015df93ad7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e16c32-3cab-41d0-a997-015df93ad7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1277190532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0d3a98-a707-4b1c-9315-213a82e1ba01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:46Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60fda1f-a874-412a-8379-4d5018b769a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60fda1f-a874-412a-8379-4d5018b769a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6236e9a6-4eac-481a-af42-3e871ad8cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6236e9a6-4eac-481a-af42-3e871ad8cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f0d3a98-a707-4b1c-9315-213a82e1ba01', 'volume_name': 'volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78077507-dfc2-4bdc-aaba-6a0d7056f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78077507-dfc2-4bdc-aaba-6a0d7056f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb34d5aa-0480-45b5-aa9f-4b58c113ec23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:45 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume 9f0d3a98-a707-4b1c-9315-213a82e1ba01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01', 'volume_size': 1}
Apr 15 16:31:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Flow 'volume_create_manager' (e2f5f924-c8b4-4402-817d-8de8ce5a51ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b4baed-cc32-4afc-873d-235c76de0b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b4baed-cc32-4afc-873d-235c76de0b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1264480448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87d22ed-335e-4fa0-a3e8-cabc003211d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d796cb14de324a39831691da4061ccfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:46Z,use_quota=True,user_id='505eac620e30421587b1d86ba30d13fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ac32b9-ff1b-4c6e-9f66-43f42c853932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ac32b9-ff1b-4c6e-9f66-43f42c853932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3689d601-408c-4ea4-8c15-3ddd6eba17a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3689d601-408c-4ea4-8c15-3ddd6eba17a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b87d22ed-335e-4fa0-a3e8-cabc003211d2', 'volume_name': 'volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3659ab0-3c02-45f8-bddd-6e422946dcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3659ab0-3c02-45f8-bddd-6e422946dcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b940e33-f97f-4e85-8477-4f9dc1d8bb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:46 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Volume b87d22ed-335e-4fa0-a3e8-cabc003211d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2', 'volume_size': 1}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Acquiring lock "cinder-58333965-7080-4668-a671-23d0a03ed9ed-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Lock "cinder-58333965-7080-4668-a671-23d0a03ed9ed-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Acquiring lock "cinder-quobyte-58333965-7080-4668-a671-23d0a03ed9ed" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Lock "cinder-quobyte-58333965-7080-4668-a671-23d0a03ed9ed" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd109b1-3b0a-4fce-a11e-31f4b6afd5bf]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:46 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6" returned: 0 in 2.302s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95cc217-9c02-4436-bbbf-d6fdebe60309]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:46 devstack sudo[87081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed
Apr 15 16:31:46 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:46 devstack sudo[87082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c
Apr 15 16:31:46 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:46 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed" returned: 0 in 0.470s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:46 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed
Apr 15 16:31:46 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:47 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c" returned: 0 in 0.596s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:31:47 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Converted 1024.00 MB image at 444.48 MB/s
Apr 15 16:31:47 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6 is being set with open permissions: ugo+rw
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:47 devstack sudo[87093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6
Apr 15 16:31:47 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:47 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-58333965-7080-4668-a671-23d0a03ed9ed" returned: 0 in 0.423s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Lock "cinder-quobyte-58333965-7080-4668-a671-23d0a03ed9ed" released by "delete_volume" :: held 0.916s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Created reservations ['203a31df-2164-4e4b-bc3e-b933a43e424f', '37c10920-c029-4fdc-b589-0505e95598bc', 'cd6148aa-040f-43fc-8129-cefb4b6c65d5', '601052e5-5cb9-4d2c-a795-4f57d9beb5ec'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:47 devstack sudo[87097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:47 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:47 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6" returned: 0 in 0.445s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-618d39e8-0153-450e-b722-3a6280437ca6" released by "_copy_volume_from_snapshot" :: held 4.592s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-bd5e106e-f520-44c9-8778-5c69bab0902d-618d39e8-0153-450e-b722-3a6280437ca6" released by "_create_volume_from_snapshot" :: held 4.619s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.657s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.537s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1277190532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0d3a98-a707-4b1c-9315-213a82e1ba01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:46Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Creating volume 9f0d3a98-a707-4b1c-9315-213a82e1ba01 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:47 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:47 devstack sudo[87100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 1073741824
Apr 15 16:31:47 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8675428-773b-4436-8d4c-7d8fb9adef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618d39e8-0153-450e-b722-3a6280437ca6', 'volume_size': 1, 'snapshot_id': 'bd5e106e-f520-44c9-8778-5c69bab0902d'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f11278-2b80-477a-bfeb-577406b57266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:47 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Volume volume-618d39e8-0153-450e-b722-3a6280437ca6 (618d39e8-0153-450e-b722-3a6280437ca6): created successfully
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f11278-2b80-477a-bfeb-577406b57266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Flow 'volume_create_manager' (68da39f8-4187-4268-b547-9e558eb3db06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:47 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c497e7af-955c-4035-898a-24bd3be14306 tempest-VolumesDeleteCascade-1957663945 None] Created volume successfully.
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Flow 'volume_create_manager' (8784dfd1-1b37-47d3-87e7-37fcf0fbc5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f704d824-25df-4cac-9593-2d8158e60333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f704d824-25df-4cac-9593-2d8158e60333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-971788287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c92e92f-1830-4626-a812-86401fa996c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05ccb111aae493fad2f05a72ff63554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:48Z,use_quota=True,user_id='e4010608c6464dd49687ae5dc4a80c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2693704f-c1e9-46e1-801f-35c7bc289dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2693704f-c1e9-46e1-801f-35c7bc289dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca04fa9b-9409-4d74-839c-0411b689b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca04fa9b-9409-4d74-839c-0411b689b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c92e92f-1830-4626-a812-86401fa996c8', 'volume_name': 'volume-1c92e92f-1830-4626-a812-86401fa996c8', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee178b0d-209c-43a4-acf6-fdd82596bad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee178b0d-209c-43a4-acf6-fdd82596bad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7d1cbf-4b61-4375-820c-e4fcb4567a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:47 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Volume 1c92e92f-1830-4626-a812-86401fa996c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c92e92f-1830-4626-a812-86401fa996c8', 'volume_size': 1}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:47 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.473s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:47 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Deleted volume successfully.
Apr 15 16:31:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-120aff5d-9041-431b-8303-6fda6332fca7 tempest-VolumesTransfersV357Test-1354723905 None] Lock "cinder-58333965-7080-4668-a671-23d0a03ed9ed-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:48 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 1073741824" returned: 0 in 0.529s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:48 devstack sudo[87106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01
Apr 15 16:31:48 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-caeba77a-77d5-4af6-9653-54260c1bfc0c-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-caeba77a-77d5-4af6-9653-54260c1bfc0c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:48 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01" returned: 0 in 0.442s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.161s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1264480448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87d22ed-335e-4fa0-a3e8-cabc003211d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d796cb14de324a39831691da4061ccfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:46Z,use_quota=True,user_id='505eac620e30421587b1d86ba30d13fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Creating volume b87d22ed-335e-4fa0-a3e8-cabc003211d2 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:48 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb34d5aa-0480-45b5-aa9f-4b58c113ec23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bea3e7-1564-4350-9799-87a2061f56c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:48 devstack sudo[87111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2 1073741824
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Performing cascade delete. {{(pid=82156) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 16:31:48 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-bd5e106e-f520-44c9-8778-5c69bab0902d-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:48 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 (9f0d3a98-a707-4b1c-9315-213a82e1ba01): created successfully
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bea3e7-1564-4350-9799-87a2061f56c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (c26b2fa6-bcb5-4edd-bb2d-c00524fa722b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-bd5e106e-f520-44c9-8778-5c69bab0902d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-caeba77a-77d5-4af6-9653-54260c1bfc0c" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:48 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d2abe35d-2f62-4f3c-b5fd-29fe4ca74e36 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created volume successfully.
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-caeba77a-77d5-4af6-9653-54260c1bfc0c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-bd5e106e-f520-44c9-8778-5c69bab0902d" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-bd5e106e-f520-44c9-8778-5c69bab0902d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Deleting offline snapshot bd5e106e-f520-44c9-8778-5c69bab0902d of volume caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] snapshot_file for this snap is: volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abb5f09-56d5-4a59-b0d8-bc906c69089d]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:48 devstack sudo[87113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d
Apr 15 16:31:48 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:49 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2 1073741824" returned: 0 in 0.526s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:49 devstack sudo[87121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2
Apr 15 16:31:49 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:49 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d" returned: 0 in 0.521s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caeba77a-77d5-4af6-9653-54260c1bfc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6f4ed9-803c-4aa5-9079-03111c81b006]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:49 devstack sudo[87123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c
Apr 15 16:31:49 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:49 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2" returned: 0 in 0.421s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-971788287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c92e92f-1830-4626-a812-86401fa996c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05ccb111aae493fad2f05a72ff63554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:48Z,use_quota=True,user_id='e4010608c6464dd49687ae5dc4a80c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Creating volume 1c92e92f-1830-4626-a812-86401fa996c8 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:49 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b940e33-f97f-4e85-8477-4f9dc1d8bb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a09b3a-3951-4469-8ad9-fc7c6e671d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:49 devstack sudo[87126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8 1073741824
Apr 15 16:31:49 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:49 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Volume volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2 (b87d22ed-335e-4fa0-a3e8-cabc003211d2): created successfully
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a09b3a-3951-4469-8ad9-fc7c6e671d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Flow 'volume_create_manager' (e2f5f924-c8b4-4402-817d-8de8ce5a51ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:49 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5b4e83d6-bd38-4f1b-b6e8-2b92cd31ebe1 tempest-VolumesTransfersV355Test-1004228449 None] Created volume successfully.
Apr 15 16:31:49 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c" returned: 0 in 0.485s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:49 devstack sudo[87131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d
Apr 15 16:31:49 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:49 devstack sudo[87133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:49 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:50 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8 1073741824" returned: 0 in 0.506s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:50 devstack sudo[87141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8
Apr 15 16:31:50 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:50 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d" returned: 0 in 0.495s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:50 devstack sudo[87144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d
Apr 15 16:31:50 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:50 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.443s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:50 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8" returned: 0 in 0.445s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.415s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Creating offline snapshot 740c0756-17d3-4203-a86c-ab3e27992686 of volume 9f0d3a98-a707-4b1c-9315-213a82e1ba01 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7d1cbf-4b61-4375-820c-e4fcb4567a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c92e92f-1830-4626-a812-86401fa996c8', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539f7a39-bf94-4fb2-9695-e9eef6dc67fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9f6fae-46b6-4bf6-bb50-dc043df65b7c]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:50 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Volume volume-1c92e92f-1830-4626-a812-86401fa996c8 (1c92e92f-1830-4626-a812-86401fa996c8): created successfully
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539f7a39-bf94-4fb2-9695-e9eef6dc67fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Flow 'volume_create_manager' (8784dfd1-1b37-47d3-87e7-37fcf0fbc5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:50 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6278cc3e-ac75-42cc-8ea1-66ffee833a95 tempest-VolumesTransfersV357Test-1989870037 None] Created volume successfully.
Apr 15 16:31:50 devstack sudo[87148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01
Apr 15 16:31:50 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:50 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-161a6783-db14-4136-894b-e04c0fa84d28 tempest-VolumesTransfersV355Test-1980023365 None] Transfer volume completed successfully.
Apr 15 16:31:50 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c.bd5e106e-f520-44c9-8778-5c69bab0902d" returned: 0 in 0.513s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-bd5e106e-f520-44c9-8778-5c69bab0902d" released by "_delete_snapshot" :: held 2.061s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-caeba77a-77d5-4af6-9653-54260c1bfc0c" released by "delete_snapshot" :: held 2.072s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Created reservations ['5d7e414c-a83a-4c26-9818-234ee2aa713f', 'f80edb42-0803-4417-8bb9-ea698f382d28', 'cef04ac2-9275-4077-87a6-c78c33d45ffa', 'a24b605c-bbd8-4057-b64d-9526dda28fad'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:50 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Delete snapshot completed successfully.
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-bd5e106e-f520-44c9-8778-5c69bab0902d-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Snapshots deleted, issuing volume delete {{(pid=82156) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-caeba77a-77d5-4af6-9653-54260c1bfc0c" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-caeba77a-77d5-4af6-9653-54260c1bfc0c" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605a4b5-5d77-4932-b8bd-090b1ab91bdc]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:50 devstack sudo[87150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c
Apr 15 16:31:50 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:51 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Acquiring lock "cinder-1c92e92f-1830-4626-a812-86401fa996c8-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01" returned: 0 in 0.543s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Lock "cinder-1c92e92f-1830-4626-a812-86401fa996c8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:51 devstack sudo[87155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 1G
Apr 15 16:31:51 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Acquiring lock "cinder-quobyte-1c92e92f-1830-4626-a812-86401fa996c8" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Lock "cinder-quobyte-1c92e92f-1830-4626-a812-86401fa996c8" acquired by "delete_volume" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0a0106-7da9-41e5-a735-59d197b9c54f]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:51 devstack sudo[87157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8
Apr 15 16:31:51 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:51 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c" returned: 0 in 0.524s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:51 devstack sudo[87162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c
Apr 15 16:31:51 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Acquiring lock "cinder-b87d22ed-335e-4fa0-a3e8-cabc003211d2-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Lock "cinder-b87d22ed-335e-4fa0-a3e8-cabc003211d2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Acquiring lock "cinder-quobyte-b87d22ed-335e-4fa0-a3e8-cabc003211d2" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Lock "cinder-quobyte-b87d22ed-335e-4fa0-a3e8-cabc003211d2" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[003c04b3-e0ca-4b47-b4de-d38c074ceac4]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:51 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 1G" returned: 0 in 0.567s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:51 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2
Apr 15 16:31:51 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:51 devstack sudo[87171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686
Apr 15 16:31:51 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:51 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8" returned: 0 in 0.615s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:51 devstack sudo[87175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8
Apr 15 16:31:51 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:51 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-caeba77a-77d5-4af6-9653-54260c1bfc0c" returned: 0 in 0.515s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-caeba77a-77d5-4af6-9653-54260c1bfc0c" released by "delete_volume" :: held 1.068s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Created reservations ['16c958ec-4530-4c92-b18e-88b8ad30ba90', 'cf6a70d8-739f-4bda-8c59-5125114707cf', '95bac254-3a7f-49cc-b0df-045c005d9e60', 'd7b108bd-261f-49da-8cbf-1a450df5721c'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:51 devstack sudo[87177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:51 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:52 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2" returned: 0 in 0.523s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:52 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686" returned: 0 in 0.466s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:52 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 is being set with open permissions: ugo+rw
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:52 devstack sudo[87185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2
Apr 15 16:31:52 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:52 devstack sudo[87186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686
Apr 15 16:31:52 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:52 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1c92e92f-1830-4626-a812-86401fa996c8" returned: 0 in 0.486s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Lock "cinder-quobyte-1c92e92f-1830-4626-a812-86401fa996c8" released by "delete_volume" :: held 1.125s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Created reservations ['9124b164-2fa2-49d3-9221-9335907c38f9', 'db23e909-1f27-478d-bd0f-d2e828c63dfe', 'bddf8496-e87b-4a5c-903b-25e7620619ed', '89e8280b-ee13-4026-9219-6c8ccaebf827'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:52 devstack sudo[87191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:52 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:52 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.492s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Deleted volume successfully.
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3e4f012a-566d-49b7-a98b-d5abce5efed0 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-caeba77a-77d5-4af6-9653-54260c1bfc0c-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:52 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b87d22ed-335e-4fa0-a3e8-cabc003211d2" returned: 0 in 0.457s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Lock "cinder-quobyte-b87d22ed-335e-4fa0-a3e8-cabc003211d2" released by "delete_volume" :: held 0.998s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:52 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Created reservations ['ce745283-0314-45d9-8054-4275fcd4bf40', '17221c16-868c-4706-a150-5ea8e4f00b98', '982a0aa5-eb49-4c57-ad5a-ab7df54793b4', '556254b2-16a5-4441-8966-94ccb352524d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:52 devstack sudo[87195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.info
Apr 15 16:31:52 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:52 devstack sudo[87197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:52 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:52 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.453s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Deleted volume successfully.
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-23647552-be4f-42bf-a5fc-efd6a9e5a1b1 tempest-VolumesTransfersV357Test-1354723905 None] Lock "cinder-1c92e92f-1830-4626-a812-86401fa996c8-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-618d39e8-0153-450e-b722-3a6280437ca6-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-618d39e8-0153-450e-b722-3a6280437ca6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "cinder-quobyte-618d39e8-0153-450e-b722-3a6280437ca6" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-618d39e8-0153-450e-b722-3a6280437ca6" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[986d46eb-b656-445a-b0ba-7481e3dfff63]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:53 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6
Apr 15 16:31:53 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:53 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.info" returned: 0 in 0.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:53 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.info is being set with open permissions: ugo+rw
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:53 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.449s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:53 devstack sudo[87204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.info
Apr 15 16:31:53 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:53 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Deleted volume successfully.
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7488898b-086f-4750-892f-a5eeb0d823d1 tempest-VolumesTransfersV355Test-1735301989 None] Lock "cinder-b87d22ed-335e-4fa0-a3e8-cabc003211d2-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:53 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6" returned: 0 in 0.536s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:53 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.info" returned: 0 in 0.421s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:53 devstack sudo[87210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6
Apr 15 16:31:53 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:53 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6abc9b9e-dc72-4729-aab8-491a863a5ee4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Create snapshot completed successfully
Apr 15 16:31:53 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Flow 'volume_create_manager' (6ec5fc84-a5da-4b01-a2b4-ee3926614319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43ed0e2-646a-4575-baa5-a71a6fac5793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43ed0e2-646a-4575-baa5-a71a6fac5793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-939250981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4508164e-99bd-4a82-a9e5-ca0e130fa225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d796cb14de324a39831691da4061ccfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:54Z,use_quota=True,user_id='505eac620e30421587b1d86ba30d13fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b47e466-800b-4271-9e1e-4e3faf54579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b47e466-800b-4271-9e1e-4e3faf54579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcaed140-fe33-40b6-8b01-06773eae4104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcaed140-fe33-40b6-8b01-06773eae4104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4508164e-99bd-4a82-a9e5-ca0e130fa225', 'volume_name': 'volume-4508164e-99bd-4a82-a9e5-ca0e130fa225', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a253a7e0-0820-4dc2-b575-96bba3026d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a253a7e0-0820-4dc2-b575-96bba3026d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37245da1-bb05-4b9a-823c-4c475a36855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Volume 4508164e-99bd-4a82-a9e5-ca0e130fa225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4508164e-99bd-4a82-a9e5-ca0e130fa225', 'volume_size': 1}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-939250981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4508164e-99bd-4a82-a9e5-ca0e130fa225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d796cb14de324a39831691da4061ccfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:54Z,use_quota=True,user_id='505eac620e30421587b1d86ba30d13fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Creating volume 4508164e-99bd-4a82-a9e5-ca0e130fa225 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:54 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-618d39e8-0153-450e-b722-3a6280437ca6" returned: 0 in 0.569s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-quobyte-618d39e8-0153-450e-b722-3a6280437ca6" released by "delete_volume" :: held 1.131s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:54 devstack sudo[87213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225 1073741824
Apr 15 16:31:54 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Created reservations ['a52fb7eb-0c4c-40b8-bb36-d66c30977e83', '68aa0487-6f84-4cf6-9fd1-0af6e727f96c', '5d9ee89c-2d96-4673-aa6a-a13bd6cfe80b', '4f988a42-c412-49df-a13a-4c0579799974'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:54 devstack sudo[87215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:54 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (2ddaad8f-a60a-46ae-a9cd-5aaa65c4a787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e5c605-55fd-438e-a922-f3eae3fe9069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e5c605-55fd-438e-a922-f3eae3fe9069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-274508576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820ba50e-1100-4bb0-953f-acfa7c103817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:55Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9addde-fd23-4216-a213-20503086351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9addde-fd23-4216-a213-20503086351d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f90d0f7-98c6-40e5-b1d3-ff574e3301fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f90d0f7-98c6-40e5-b1d3-ff574e3301fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820ba50e-1100-4bb0-953f-acfa7c103817', 'volume_name': 'volume-820ba50e-1100-4bb0-953f-acfa7c103817', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11b6461-6b19-470f-a144-aa28f5406604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11b6461-6b19-470f-a144-aa28f5406604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718a8f65-5bee-45ab-818c-3a1688dc6c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume 820ba50e-1100-4bb0-953f-acfa7c103817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820ba50e-1100-4bb0-953f-acfa7c103817', 'volume_size': 1}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:54 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.558s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:54 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Deleted volume successfully.
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-77005cfe-5757-4c3e-95b0-6a484ab61df8 tempest-VolumesDeleteCascade-1957663945 None] Lock "cinder-618d39e8-0153-450e-b722-3a6280437ca6-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:54 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225 1073741824" returned: 0 in 0.719s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:54 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225
Apr 15 16:31:54 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (cbe40e67-ca3d-40b3-8475-b4c84d936029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3c273e-8c81-4c0d-aa99-8cf72956dce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3c273e-8c81-4c0d-aa99-8cf72956dce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-882658916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eecda17-3fe2-40b8-b104-d1b6aac7bec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:55Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18da463b-dcfc-468f-9268-d30729b5f817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18da463b-dcfc-468f-9268-d30729b5f817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94894162-34e4-4a17-b8f9-25b890252f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94894162-34e4-4a17-b8f9-25b890252f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eecda17-3fe2-40b8-b104-d1b6aac7bec5', 'volume_name': 'volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b9e81c-a0e4-4df3-be0d-434b6c50323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b9e81c-a0e4-4df3-be0d-434b6c50323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a38083-fb73-4d54-8b34-a12f7d37362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:54 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume 5eecda17-3fe2-40b8-b104-d1b6aac7bec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5', 'volume_size': 1}
Apr 15 16:31:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (7ed4cf02-190e-467e-8cc2-6dd4474f565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e190f2-af34-4052-b239-303cf18bdfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e190f2-af34-4052-b239-303cf18bdfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672656715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbea7f1-d6b7-466c-81b7-54fc55a008da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:55Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac360914-c003-443e-986e-13dc81722c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac360914-c003-443e-986e-13dc81722c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2c38e8-eb0c-41c1-a086-c85c9b87f7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2c38e8-eb0c-41c1-a086-c85c9b87f7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbea7f1-d6b7-466c-81b7-54fc55a008da', 'volume_name': 'volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a5498a-6331-46a8-8b72-e557eda00f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a5498a-6331-46a8-8b72-e557eda00f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029d4250-e7a4-4836-8a2d-48bbd70b4542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume 3bbea7f1-d6b7-466c-81b7-54fc55a008da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da', 'volume_size': 1}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (78b3ca53-6e1d-4e74-b61d-4f65a3fac909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b81472-fd79-41cb-91c5-8a2099a915d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b81472-fd79-41cb-91c5-8a2099a915d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-714387079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a911def2-02f0-4a20-99c1-3650021b85b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:55Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ee1756-3275-4978-b03b-48b2a0dce95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ee1756-3275-4978-b03b-48b2a0dce95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534f3503-53c3-40b9-9317-65358d54edba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534f3503-53c3-40b9-9317-65358d54edba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a911def2-02f0-4a20-99c1-3650021b85b6', 'volume_name': 'volume-a911def2-02f0-4a20-99c1-3650021b85b6', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea232e7-843e-48ba-8bb4-56356dae03de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea232e7-843e-48ba-8bb4-56356dae03de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa551b0-9597-4053-93e7-ff9fe6b7a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume a911def2-02f0-4a20-99c1-3650021b85b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a911def2-02f0-4a20-99c1-3650021b85b6', 'volume_size': 1}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:55 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225" returned: 0 in 0.684s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.822s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-274508576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820ba50e-1100-4bb0-953f-acfa7c103817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:55Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Creating volume 820ba50e-1100-4bb0-953f-acfa7c103817 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:55 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:55 devstack sudo[87224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817 1073741824
Apr 15 16:31:55 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37245da1-bb05-4b9a-823c-4c475a36855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4508164e-99bd-4a82-a9e5-ca0e130fa225', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58adea30-b589-4c9c-8e2a-3e25afac5560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Volume volume-4508164e-99bd-4a82-a9e5-ca0e130fa225 (4508164e-99bd-4a82-a9e5-ca0e130fa225): created successfully
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58adea30-b589-4c9c-8e2a-3e25afac5560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Flow 'volume_create_manager' (6ec5fc84-a5da-4b01-a2b4-ee3926614319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:55 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cc9d8d68-1df9-465b-9f40-16d454a12406 tempest-VolumesTransfersV355Test-1004228449 None] Created volume successfully.
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (7e76f2b6-ccbc-4267-b978-ca63b65994f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e80cd1-f5c0-4730-997a-4c311c62fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e80cd1-f5c0-4730-997a-4c311c62fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1406719994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afb8c1d-7c3e-47e0-9082-e4e49f04047c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:56Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6fa7b3-b86f-4091-90a9-3f8066001d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6fa7b3-b86f-4091-90a9-3f8066001d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf9ed58-575e-45e5-a211-082c70dbc36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf9ed58-575e-45e5-a211-082c70dbc36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8afb8c1d-7c3e-47e0-9082-e4e49f04047c', 'volume_name': 'volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dceb267e-ed1f-4c87-8310-e24d9012c160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dceb267e-ed1f-4c87-8310-e24d9012c160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11191d6f-f8e9-4baa-b8d6-9a425914156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:55 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume 8afb8c1d-7c3e-47e0-9082-e4e49f04047c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c', 'volume_size': 1}
Apr 15 16:31:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:56 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817 1073741824" returned: 0 in 0.631s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:56 devstack sudo[87229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817
Apr 15 16:31:56 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Acquiring lock "cinder-4508164e-99bd-4a82-a9e5-ca0e130fa225-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Lock "cinder-4508164e-99bd-4a82-a9e5-ca0e130fa225-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Acquiring lock "cinder-quobyte-4508164e-99bd-4a82-a9e5-ca0e130fa225" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Lock "cinder-quobyte-4508164e-99bd-4a82-a9e5-ca0e130fa225" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b09740-06f6-40f7-a520-cc5ddbe2f107]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:56 devstack sudo[87231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225
Apr 15 16:31:56 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:56 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817" returned: 0 in 0.556s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-882658916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eecda17-3fe2-40b8-b104-d1b6aac7bec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:55Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Creating volume 5eecda17-3fe2-40b8-b104-d1b6aac7bec5 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:56 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718a8f65-5bee-45ab-818c-3a1688dc6c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820ba50e-1100-4bb0-953f-acfa7c103817', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cea7cc-6cbb-419d-8ebc-8a6f7a3eedf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:56 devstack sudo[87234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5 1073741824
Apr 15 16:31:56 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume volume-820ba50e-1100-4bb0-953f-acfa7c103817 (820ba50e-1100-4bb0-953f-acfa7c103817): created successfully
Apr 15 16:31:56 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cea7cc-6cbb-419d-8ebc-8a6f7a3eedf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (2ddaad8f-a60a-46ae-a9cd-5aaa65c4a787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:56 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-28ed9a49-8da0-49dc-ac60-d712e96871ff tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created volume successfully.
Apr 15 16:31:57 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225" returned: 0 in 0.587s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:57 devstack sudo[87239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225
Apr 15 16:31:57 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:57 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5 1073741824" returned: 0 in 0.652s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:57 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5
Apr 15 16:31:57 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:57 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4508164e-99bd-4a82-a9e5-ca0e130fa225" returned: 0 in 0.594s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Lock "cinder-quobyte-4508164e-99bd-4a82-a9e5-ca0e130fa225" released by "delete_volume" :: held 1.210s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Flow 'volume_create_manager' (b017e064-8932-498f-bc79-66c206dcea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc921c1-bd4a-4b9b-a8fb-46b95452706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc921c1-bd4a-4b9b-a8fb-46b95452706e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-439514559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad74c47-36bc-43ea-aac0-94ae2cfacb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82ba571ac63447aadb3f93ff4ebdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:58Z,use_quota=True,user_id='5a0ef52beab348b6af5c7b19b5650db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f8fee5-bfbe-4345-8b60-15ab2dcdd5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f8fee5-bfbe-4345-8b60-15ab2dcdd5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa8e201-38c5-40a6-aec5-50aae9046ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa8e201-38c5-40a6-aec5-50aae9046ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad74c47-36bc-43ea-aac0-94ae2cfacb24', 'volume_name': 'volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24', 'volume_size': 2}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176d650b-e6ec-46bd-9b4e-390a84629c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176d650b-e6ec-46bd-9b4e-390a84629c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c8a98d-3238-4c1a-a43f-794dfaf06a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:57 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Volume 3ad74c47-36bc-43ea-aac0-94ae2cfacb24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24', 'volume_size': 2}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Created reservations ['b825d83b-2865-43d8-88a4-03cd284c894d', '34e43cd8-b7b9-41be-b238-1cb491aeffee', '52472d6f-6bff-4c95-b601-597abb177e19', '8439cc79-30e0-4832-ac26-d380c7610bd1'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:57 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:31:57 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:57 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5" returned: 0 in 0.513s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.795s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672656715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbea7f1-d6b7-466c-81b7-54fc55a008da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:55Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Creating volume 3bbea7f1-d6b7-466c-81b7-54fc55a008da {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:57 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a38083-fb73-4d54-8b34-a12f7d37362e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9630728-d911-4e74-9b30-c5d99fbca90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:57 devstack sudo[87251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da 1073741824
Apr 15 16:31:57 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:57 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5 (5eecda17-3fe2-40b8-b104-d1b6aac7bec5): created successfully
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9630728-d911-4e74-9b30-c5d99fbca90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (cbe40e67-ca3d-40b3-8475-b4c84d936029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:58 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-a930dc88-d825-4357-aa5e-b9acee94da7b tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created volume successfully.
Apr 15 16:31:58 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.423s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:58 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:31:58 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Deleted volume successfully.
Apr 15 16:31:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-051c43d7-455a-41d5-ba78-05bd46660498 tempest-VolumesTransfersV355Test-1735301989 None] Lock "cinder-4508164e-99bd-4a82-a9e5-ca0e130fa225-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:31:58 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da 1073741824" returned: 0 in 0.539s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:58 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da
Apr 15 16:31:58 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:59 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da" returned: 0 in 0.528s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.635s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-714387079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a911def2-02f0-4a20-99c1-3650021b85b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:55Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Creating volume a911def2-02f0-4a20-99c1-3650021b85b6 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:31:59 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029d4250-e7a4-4836-8a2d-48bbd70b4542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b3d0bb-ec02-4c41-8e09-b873ea3cf561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:31:59 devstack sudo[87260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6 1073741824
Apr 15 16:31:59 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:31:59 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da (3bbea7f1-d6b7-466c-81b7-54fc55a008da): created successfully
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b3d0bb-ec02-4c41-8e09-b873ea3cf561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (7ed4cf02-190e-467e-8cc2-6dd4474f565a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:31:59 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9174bfa4-1307-4343-ae71-69d97703ffb4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created volume successfully.
Apr 15 16:31:59 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6 1073741824" returned: 0 in 0.661s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:31:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:31:59 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6
Apr 15 16:31:59 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:00 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6" returned: 0 in 0.524s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.565s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1406719994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afb8c1d-7c3e-47e0-9082-e4e49f04047c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7471f4ed839e4128bd4829d2c0941243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:56Z,use_quota=True,user_id='3c33a261fc0c4c4081f5c8d6c2842244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Creating volume 8afb8c1d-7c3e-47e0-9082-e4e49f04047c {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:00 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa551b0-9597-4053-93e7-ff9fe6b7a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a911def2-02f0-4a20-99c1-3650021b85b6', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e108ce31-deea-4d70-8e74-cd2af31195dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:00 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume volume-a911def2-02f0-4a20-99c1-3650021b85b6 (a911def2-02f0-4a20-99c1-3650021b85b6): created successfully
Apr 15 16:32:00 devstack sudo[87268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c 1073741824
Apr 15 16:32:00 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e108ce31-deea-4d70-8e74-cd2af31195dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (78b3ca53-6e1d-4e74-b61d-4f65a3fac909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:00 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-71dad150-298a-42bc-af48-2a9d8f118d0e tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created volume successfully.
Apr 15 16:32:00 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c 1073741824" returned: 0 in 0.636s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:00 devstack sudo[87273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c
Apr 15 16:32:00 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:01 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c" returned: 0 in 0.545s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.729s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-439514559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad74c47-36bc-43ea-aac0-94ae2cfacb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82ba571ac63447aadb3f93ff4ebdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:31:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:31:58Z,use_quota=True,user_id='5a0ef52beab348b6af5c7b19b5650db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Creating volume 3ad74c47-36bc-43ea-aac0-94ae2cfacb24 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:01 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24 2147483648 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11191d6f-f8e9-4baa-b8d6-9a425914156a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab975131-0a00-4c34-8886-a747ca253363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:01 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Volume volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c (8afb8c1d-7c3e-47e0-9082-e4e49f04047c): created successfully
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab975131-0a00-4c34-8886-a747ca253363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Flow 'volume_create_manager' (7e76f2b6-ccbc-4267-b978-ca63b65994f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:01 devstack sudo[87276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24 2147483648
Apr 15 16:32:01 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:01 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-019867bc-82b8-4db5-a4a2-9653b51996af tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created volume successfully.
Apr 15 16:32:02 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24 2147483648" returned: 0 in 0.631s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:02 devstack sudo[87281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24
Apr 15 16:32:02 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-8afb8c1d-7c3e-47e0-9082-e4e49f04047c-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-8afb8c1d-7c3e-47e0-9082-e4e49f04047c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-quobyte-8afb8c1d-7c3e-47e0-9082-e4e49f04047c" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-8afb8c1d-7c3e-47e0-9082-e4e49f04047c" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb03515f-29f5-4668-af85-0d8ff2fd43b9]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:02 devstack sudo[87283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c
Apr 15 16:32:02 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Flow 'volume_create_manager' (297ed63d-d04f-4fc7-a69d-239f1b222886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c0ef77-eee6-4c52-8ea4-cfc451daf2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c0ef77-eee6-4c52-8ea4-cfc451daf2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-303290770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a645ff-028c-4949-b88c-73c27b4bc05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49313710a8dc4ec592500107f6d21065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:02Z,use_quota=True,user_id='18232b1f1ae04b2a88548d22256246e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d18a4f1-927c-4def-9f0e-73ab41549bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d18a4f1-927c-4def-9f0e-73ab41549bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a96117-6b5c-4fb9-9cdd-9206e5d70666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a96117-6b5c-4fb9-9cdd-9206e5d70666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a645ff-028c-4949-b88c-73c27b4bc05e', 'volume_name': 'volume-86a645ff-028c-4949-b88c-73c27b4bc05e', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe1c802-7b5f-4382-a2f8-3d48083f5e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe1c802-7b5f-4382-a2f8-3d48083f5e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3457451e-7521-4617-a5ac-3f035c2a90fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:02 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Volume 86a645ff-028c-4949-b88c-73c27b4bc05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a645ff-028c-4949-b88c-73c27b4bc05e', 'volume_size': 1}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:02 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24" returned: 0 in 0.687s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-303290770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a645ff-028c-4949-b88c-73c27b4bc05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49313710a8dc4ec592500107f6d21065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:02Z,use_quota=True,user_id='18232b1f1ae04b2a88548d22256246e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Creating volume 86a645ff-028c-4949-b88c-73c27b4bc05e {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:02 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=178,cinder:INSERT=60,cinder:UPDATE=243,cinder:DELETE=20 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c8a98d-3238-4c1a-a43f-794dfaf06a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24', 'volume_size': 2}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd93e1fe-d041-468f-a252-f1abdf22007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:02 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e 1073741824
Apr 15 16:32:02 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=200,cinder:UPDATE=241,cinder:DELETE=25,cinder:INSERT=64 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:32:02 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Volume volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24 (3ad74c47-36bc-43ea-aac0-94ae2cfacb24): created successfully
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd93e1fe-d041-468f-a252-f1abdf22007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Flow 'volume_create_manager' (b017e064-8932-498f-bc79-66c206dcea87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:02 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e0bcc300-440d-4039-871d-559e3de34bb5 tempest-VolumesCloneNegativeTest-1867847877 None] Created volume successfully.
Apr 15 16:32:02 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c" returned: 0 in 0.626s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:03 devstack sudo[87291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c
Apr 15 16:32:03 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:03 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e 1073741824" returned: 0 in 0.648s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:03 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8afb8c1d-7c3e-47e0-9082-e4e49f04047c" returned: 0 in 0.536s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-8afb8c1d-7c3e-47e0-9082-e4e49f04047c" released by "delete_volume" :: held 1.196s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:03 devstack sudo[87297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e
Apr 15 16:32:03 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created reservations ['d4c2d875-c60c-4ef5-85e0-9dc49a16834a', 'acf349ce-ece7-4625-bc2e-3d38bd9a28de', '6f5cf073-3e77-4c87-a3a2-335f031fa4a4', '450ecb9f-0a18-4234-9579-21f9f6f7f8de'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:03 devstack sudo[87299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:03 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:03 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e" returned: 0 in 0.467s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3457451e-7521-4617-a5ac-3f035c2a90fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a645ff-028c-4949-b88c-73c27b4bc05e', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e667a5-ce65-470c-837c-d3ab595618f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:04 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Volume volume-86a645ff-028c-4949-b88c-73c27b4bc05e (86a645ff-028c-4949-b88c-73c27b4bc05e): created successfully
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e667a5-ce65-470c-837c-d3ab595618f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Flow 'volume_create_manager' (297ed63d-d04f-4fc7-a69d-239f1b222886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:04 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3205d8a3-c8ad-47a1-bf60-5bcc5dfddc69 tempest-VolumesNegativeTest-1406197163 None] Created volume successfully.
Apr 15 16:32:04 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.492s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:04 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Deleted volume successfully.
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f992b0d3-b4a1-446f-9138-e351ce7326ba tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-8afb8c1d-7c3e-47e0-9082-e4e49f04047c-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Acquiring lock "cinder-3ad74c47-36bc-43ea-aac0-94ae2cfacb24-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Lock "cinder-3ad74c47-36bc-43ea-aac0-94ae2cfacb24-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Acquiring lock "cinder-quobyte-3ad74c47-36bc-43ea-aac0-94ae2cfacb24" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Lock "cinder-quobyte-3ad74c47-36bc-43ea-aac0-94ae2cfacb24" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[042d3f48-8f82-4036-9b48-8af3e8533299]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:04 devstack sudo[87305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24
Apr 15 16:32:04 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-a911def2-02f0-4a20-99c1-3650021b85b6-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-a911def2-02f0-4a20-99c1-3650021b85b6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-quobyte-a911def2-02f0-4a20-99c1-3650021b85b6" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-a911def2-02f0-4a20-99c1-3650021b85b6" acquired by "delete_volume" :: waited 0.020s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a387bc-fcb7-425a-babe-1c255e629576]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:04 devstack sudo[87308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6
Apr 15 16:32:04 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:04 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24" returned: 0 in 0.679s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:04 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24
Apr 15 16:32:04 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:05 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6" returned: 0 in 0.780s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:05 devstack sudo[87318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6
Apr 15 16:32:05 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:05 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3ad74c47-36bc-43ea-aac0-94ae2cfacb24" returned: 0 in 0.600s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Lock "cinder-quobyte-3ad74c47-36bc-43ea-aac0-94ae2cfacb24" released by "delete_volume" :: held 1.321s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Created reservations ['9483ff1e-3b9b-4061-a58e-391970a327fa', 'acb65641-65e2-4852-b8d8-42364d6f7b03', '786e6efa-9733-414e-abee-830fe7c9f432', '8207ae14-f369-4ab6-b5f9-2e2a48fcbad4'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:05 devstack sudo[87321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:05 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:05 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Flow 'volume_create_manager' (e43ce965-be4e-4820-b25c-47c55c62d55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b8d9bb-f859-4c7e-8dc5-6f04a4da2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b8d9bb-f859-4c7e-8dc5-6f04a4da2cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1686698310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd64687e-c0e8-4e93-9485-0f962c245bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc85a652f3f4578a10e2be5eb4acbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:06Z,use_quota=True,user_id='0340d41042dc42ff8699b6980ab752e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:06 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9ce549-d4ad-49a7-b1d3-8d0fbfd2c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9ce549-d4ad-49a7-b1d3-8d0fbfd2c485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de50d95c-5adf-41d6-8099-d87ac68d47fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de50d95c-5adf-41d6-8099-d87ac68d47fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd64687e-c0e8-4e93-9485-0f962c245bce', 'volume_name': 'volume-dd64687e-c0e8-4e93-9485-0f962c245bce', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f96c61-0626-432c-b43c-c54bf7c9ca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f96c61-0626-432c-b43c-c54bf7c9ca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3956bbca-23ad-4958-89d7-aeee33bd56f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:06 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Volume dd64687e-c0e8-4e93-9485-0f962c245bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd64687e-c0e8-4e93-9485-0f962c245bce', 'volume_size': 1}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1686698310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd64687e-c0e8-4e93-9485-0f962c245bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc85a652f3f4578a10e2be5eb4acbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:06Z,use_quota=True,user_id='0340d41042dc42ff8699b6980ab752e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Creating volume dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:06 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-a911def2-02f0-4a20-99c1-3650021b85b6" returned: 0 in 0.727s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-a911def2-02f0-4a20-99c1-3650021b85b6" released by "delete_volume" :: held 1.540s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:06 devstack sudo[87327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce 1073741824
Apr 15 16:32:06 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created reservations ['5a8a3c93-a7d9-408a-993c-422c9bd40d06', '9c36bb3b-dfa9-4957-8c26-3c7f9bfe524d', 'e581ef20-a77a-4433-a1bb-fd01ee7d6dc0', 'da899533-d4e8-41ff-b01c-994e85b59d3f'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:06 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:06 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:06 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.593s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:06 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Deleted volume successfully.
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c53e80b7-5252-47f2-917a-ac70d89513ed tempest-VolumesCloneNegativeTest-1867847877 None] Lock "cinder-3ad74c47-36bc-43ea-aac0-94ae2cfacb24-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-3bbea7f1-d6b7-466c-81b7-54fc55a008da-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:06 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce 1073741824" returned: 0 in 0.619s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-3bbea7f1-d6b7-466c-81b7-54fc55a008da-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-quobyte-3bbea7f1-d6b7-466c-81b7-54fc55a008da" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-3bbea7f1-d6b7-466c-81b7-54fc55a008da" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:06 devstack sudo[87337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce
Apr 15 16:32:06 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e9ca03-69c0-4d9e-8f0d-5d973a7567d2]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:06 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.598s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:06 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Deleted volume successfully.
Apr 15 16:32:06 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a5329dd4-fdcc-498a-bd48-a3ffb0405324 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-a911def2-02f0-4a20-99c1-3650021b85b6-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:06 devstack sudo[87339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da
Apr 15 16:32:06 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:07 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce" returned: 0 in 0.564s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3956bbca-23ad-4958-89d7-aeee33bd56f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd64687e-c0e8-4e93-9485-0f962c245bce', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2841ba57-6546-47c5-a35f-28c8ba658cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:07 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Volume volume-dd64687e-c0e8-4e93-9485-0f962c245bce (dd64687e-c0e8-4e93-9485-0f962c245bce): created successfully
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2841ba57-6546-47c5-a35f-28c8ba658cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Flow 'volume_create_manager' (e43ce965-be4e-4820-b25c-47c55c62d55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:07 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1ec02706-48a4-44d5-b889-fdb2aed7674f tempest-VolumesActionsTest-594480100 None] Created volume successfully.
Apr 15 16:32:07 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da" returned: 0 in 0.612s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:07 devstack sudo[87345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da
Apr 15 16:32:07 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:07 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3bbea7f1-d6b7-466c-81b7-54fc55a008da" returned: 0 in 0.475s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-3bbea7f1-d6b7-466c-81b7-54fc55a008da" released by "delete_volume" :: held 1.110s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created reservations ['7dc88d03-5c58-438e-bec5-09eab7f87276', '4b121042-ee64-4d80-b832-e576b8311e48', 'b0135e24-10d5-4dd4-8b22-38752beea4ab', 'ed9dd091-4698-47e9-96af-7ab2993101e0'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:07 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:07 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:08 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.500s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:08 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Deleted volume successfully.
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Flow 'volume_create_manager' (a65c898a-b10f-4c3e-818a-fbb3ea4e4e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a58f915-a4bb-4971-b7bd-b40c08ec010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a58f915-a4bb-4971-b7bd-b40c08ec010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-592565433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3cafbb-25e0-4c19-a26f-05046f3b46d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf126fc06674a7a9f3bbdb26f6a0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:08Z,use_quota=True,user_id='d2b8cdcb6fa4424f80b2b0a5b80621f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d180b215-e718-4cb5-9bd8-5c72032a146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d180b215-e718-4cb5-9bd8-5c72032a146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6e4af0-31bd-4331-9b6d-f331fb466151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.image.glance [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Creating Keystone auth plugin from conf {{(pid=82156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-797b589b-8139-4419-ab06-9aea7ceb8c0d tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-3bbea7f1-d6b7-466c-81b7-54fc55a008da-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6e4af0-31bd-4331-9b6d-f331fb466151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce3cafbb-25e0-4c19-a26f-05046f3b46d2', 'volume_name': 'volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8df255120>}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445f060f-d5e6-4ecb-b090-f41463440f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445f060f-d5e6-4ecb-b090-f41463440f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b57c0c-41ae-4559-83de-c36085ca6a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:08 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Volume ce3cafbb-25e0-4c19-a26f-05046f3b46d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8df255120>}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Trying to clone ce3cafbb-25e0-4c19-a26f-05046f3b46d2 from image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]). {{(pid=82156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-5eecda17-3fe2-40b8-b104-d1b6aac7bec5-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-5eecda17-3fe2-40b8-b104-d1b6aac7bec5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-quobyte-5eecda17-3fe2-40b8-b104-d1b6aac7bec5" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-5eecda17-3fe2-40b8-b104-d1b6aac7bec5" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4a676f-3433-40aa-806e-c01eb30a1d45]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 16:32:09 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91a0b7d-75ec-419b-9ece-69b6da9371c5]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:09 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5
Apr 15 16:32:09 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:09 devstack sudo[87357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD
Apr 15 16:32:09 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:09 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5" returned: 0 in 0.536s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:09 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5
Apr 15 16:32:09 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:09 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Temporary image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 is fetched for user d2b8cdcb6fa4424f80b2b0a5b80621f8. {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0038345-0f99-4cfa-85d4-ad4d11dd7dc2]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:09 devstack sudo[87369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD
Apr 15 16:32:09 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:09 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5eecda17-3fe2-40b8-b104-d1b6aac7bec5" returned: 0 in 0.430s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-5eecda17-3fe2-40b8-b104-d1b6aac7bec5" released by "delete_volume" :: held 0.997s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:09 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created reservations ['7f2d5575-8251-4d18-8e4e-4a56d437e784', '5088a53b-9f40-46c1-a0ae-77c6ea29d402', '5c9e6646-e13d-4e0a-98bb-cffe50e3347b', 'fb87d17a-27b6-4d89-a655-66224ba5bba5'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:10 devstack sudo[87372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:10 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:10 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD" returned: 0 in 0.562s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-592565433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3cafbb-25e0-4c19-a26f-05046f3b46d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf126fc06674a7a9f3bbdb26f6a0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:08Z,use_quota=True,user_id='d2b8cdcb6fa4424f80b2b0a5b80621f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Creating volume ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:10 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:10 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 1073741824
Apr 15 16:32:10 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:10 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.555s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:10 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Deleted volume successfully.
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1ae9cf20-7bdf-4232-a239-a4369f83f4e4 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-5eecda17-3fe2-40b8-b104-d1b6aac7bec5-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:10 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 1073741824" returned: 0 in 0.606s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:10 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2
Apr 15 16:32:10 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-820ba50e-1100-4bb0-953f-acfa7c103817-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-820ba50e-1100-4bb0-953f-acfa7c103817-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-quobyte-820ba50e-1100-4bb0-953f-acfa7c103817" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-820ba50e-1100-4bb0-953f-acfa7c103817" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f8864-2641-4e42-b217-4f8394cfe373]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:11 devstack sudo[87385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817
Apr 15 16:32:11 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:11 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" returned: 0 in 0.496s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Attempting download of 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}])) to volume ce3cafbb-25e0-4c19-a26f-05046f3b46d2. {{(pid=82156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2aa26c-c30b-477a-9527-2b80f34cddea]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_mwtoch_z {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:11 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_mwtoch_z
Apr 15 16:32:11 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:11 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817" returned: 0 in 0.647s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:11 devstack sudo[87395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817
Apr 15 16:32:11 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:11 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_mwtoch_z" returned: 0 in 0.549s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_mwtoch_z {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:11 devstack sudo[87397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_mwtoch_z
Apr 15 16:32:11 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:12 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-820ba50e-1100-4bb0-953f-acfa7c103817" returned: 0 in 0.526s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-820ba50e-1100-4bb0-953f-acfa7c103817" released by "delete_volume" :: held 1.198s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created reservations ['e5f653d2-4d2e-4182-85bb-f5fb2bc23033', 'a3bffc00-ee55-4292-a51c-7b980010eeb6', '9207eed8-8a59-4442-a503-b537bad8fd3b', '97bc065b-ae75-41c9-8996-3ef6a0de35e8'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:12 devstack sudo[87416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:12 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:12 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_mwtoch_z" returned: 1 in 0.583s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_mwtoch_z' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ee037c-984b-43ce-b667-390f07b764e1]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:12 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD
Apr 15 16:32:12 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:12 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.452s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:12 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Deleted volume successfully.
Apr 15 16:32:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2661e774-b057-40e6-89c2-ee11b3455c68 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-820ba50e-1100-4bb0-953f-acfa7c103817-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:13 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 was qcow2, converting to raw {{(pid=82156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:13 devstack sudo[87426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2
Apr 15 16:32:13 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-740c0756-17d3-4203-a86c-ab3e27992686-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-740c0756-17d3-4203-a86c-ab3e27992686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-quobyte-9f0d3a98-a707-4b1c-9315-213a82e1ba01" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-9f0d3a98-a707-4b1c-9315-213a82e1ba01" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-quobyte-740c0756-17d3-4203-a86c-ab3e27992686" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-740c0756-17d3-4203-a86c-ab3e27992686" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Deleting offline snapshot 740c0756-17d3-4203-a86c-ab3e27992686 of volume 9f0d3a98-a707-4b1c-9315-213a82e1ba01 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] snapshot_file for this snap is: volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8ecf29-713e-4ffb-9ad3-e9a8c152d7f9]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:13 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686
Apr 15 16:32:13 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:14 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686" returned: 0 in 0.638s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[792f9b91-fe4f-4209-94c7-16ef061f44e3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:14 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" returned: 0 in 0.976s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_rz57y5lpdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:32:14 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Converted 112.00 MB image at 112.00 MB/s
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:14 devstack sudo[87448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 1G
Apr 15 16:32:14 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:14 devstack sudo[87447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01
Apr 15 16:32:14 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:14 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 1G" returned: 0 in 0.529s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:14 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01" returned: 0 in 0.550s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4500ac-f2f5-4aa8-b536-431a9b51c798]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:14 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686
Apr 15 16:32:14 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:14 devstack sudo[87458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2
Apr 15 16:32:14 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:15 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686" returned: 0 in 0.529s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:15 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" returned: 0 in 0.516s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:15 devstack sudo[87468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686
Apr 15 16:32:15 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:15 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2
Apr 15 16:32:15 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:15 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01.740c0756-17d3-4203-a86c-ab3e27992686" returned: 0 in 0.494s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-740c0756-17d3-4203-a86c-ab3e27992686" released by "_delete_snapshot" :: held 2.282s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-9f0d3a98-a707-4b1c-9315-213a82e1ba01" released by "delete_snapshot" :: held 2.292s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created reservations ['a23370c2-63f8-4bbc-93a7-ade1efb0ba62', '2e6b641e-3456-48e0-8be8-554373247cc6', 'ced81831-afcc-41b6-8415-dc040ed59a49', '3fe69920-76a4-4eea-8dd9-36deab014eb7'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:15 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" returned: 1 in 0.580s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Downloaded image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}])) to volume ce3cafbb-25e0-4c19-a26f-05046f3b46d2 successfully. {{(pid=82156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Temporary image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 for user d2b8cdcb6fa4424f80b2b0a5b80621f8 is deleted. {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Marking volume ce3cafbb-25e0-4c19-a26f-05046f3b46d2 as bootable. {{(pid=82156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 16:32:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Delete snapshot completed successfully.
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Copying metadata from image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 to ce3cafbb-25e0-4c19-a26f-05046f3b46d2. {{(pid=82156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Creating volume glance metadata for volume ce3cafbb-25e0-4c19-a26f-05046f3b46d2 backed by image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7996f9cd-021d-4a62-9f1c-82c1efd76f28 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-740c0756-17d3-4203-a86c-ab3e27992686-delete_snapshot" released by "delete_snapshot" :: held 2.412s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b57c0c-41ae-4559-83de-c36085ca6a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8df255120>}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979283e4-2745-43db-88c3-098e187cbcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:15 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Volume volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 (ce3cafbb-25e0-4c19-a26f-05046f3b46d2): created successfully
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979283e4-2745-43db-88c3-098e187cbcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Flow 'volume_create_manager' (a65c898a-b10f-4c3e-818a-fbb3ea4e4e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-85fc2a07-2323-4c24-ad27-97721d56a47e tempest-VolumesExtendTest-1587287090 None] Created volume successfully.
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[69158d3c-a8b9-42bf-909b-35198536aca2]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:16 devstack sudo[87493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2
Apr 15 16:32:16 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-9f0d3a98-a707-4b1c-9315-213a82e1ba01-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:16 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-9f0d3a98-a707-4b1c-9315-213a82e1ba01-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" returned: 0 in 0.513s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "cinder-quobyte-9f0d3a98-a707-4b1c-9315-213a82e1ba01" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-9f0d3a98-a707-4b1c-9315-213a82e1ba01" acquired by "delete_volume" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0b2bec-6aa0-4c0e-9fe9-e9c559962c81]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:16 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2
Apr 15 16:32:16 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:16 devstack sudo[87498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01
Apr 15 16:32:16 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:17 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" returned: 1 in 0.633s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 2G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 2G" returned: 0 in 0.051s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.232s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:17 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-05d90c55-21b9-44ff-abe3-537913099674 tempest-VolumesExtendTest-1587287090 None] Extend volume completed successfully.
Apr 15 16:32:17 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01" returned: 0 in 0.711s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:17 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01
Apr 15 16:32:17 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:17 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9f0d3a98-a707-4b1c-9315-213a82e1ba01" returned: 0 in 0.616s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-quobyte-9f0d3a98-a707-4b1c-9315-213a82e1ba01" released by "delete_volume" :: held 1.376s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:17 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Created reservations ['1a9dda5a-2c5c-40d9-8b9b-722ef15245c8', '2794418e-8846-4196-bc2f-e1c61b6afe6c', '4df4ea06-5086-4193-b2f4-0997f98bfc88', 'd2da54cb-b0a3-45af-8a99-7f1bef5c64ce'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:18 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:18 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Acquiring lock "cinder-ce3cafbb-25e0-4c19-a26f-05046f3b46d2-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Lock "cinder-ce3cafbb-25e0-4c19-a26f-05046f3b46d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Acquiring lock "cinder-quobyte-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Lock "cinder-quobyte-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be3c8a-c879-419d-b0ef-23c1b468d823]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:18 devstack sudo[87546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2
Apr 15 16:32:18 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:18 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.485s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:18 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Deleted volume successfully.
Apr 15 16:32:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-12e4c13d-dfba-494b-8e81-dcd5f15c9a13 tempest-CreateVolumesFromSnapshotTest-1366905870 None] Lock "cinder-9f0d3a98-a707-4b1c-9315-213a82e1ba01-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:19 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" returned: 0 in 0.617s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:19 devstack sudo[87551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2
Apr 15 16:32:19 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:19 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" returned: 1 in 0.907s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:32:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:19 devstack sudo[87581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2
Apr 15 16:32:19 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:20 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" returned: 0 in 0.905s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Lock "cinder-quobyte-ce3cafbb-25e0-4c19-a26f-05046f3b46d2" released by "delete_volume" :: held 2.485s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:20 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Created reservations ['183e93ec-8fc9-429f-b319-9e7011f9b6df', '20d6ddc1-7ecd-457e-bf46-f97ab1966394', '3028fc21-37fe-4244-88df-7ec6a0a6fc0e', '38a6f1bf-0305-4039-a2cf-c80164295ce5'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:21 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:21 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:21 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.536s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:21 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:21 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Deleted volume successfully.
Apr 15 16:32:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5831d8e1-8e11-4103-8e55-063731ea1dc2 tempest-VolumesExtendTest-1587287090 None] Lock "cinder-ce3cafbb-25e0-4c19-a26f-05046f3b46d2-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:21 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Flow 'volume_create_manager' (7fd4cbe4-cc29-4b4b-b379-b49f1056297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd1e168-d01e-48cd-9fab-49ac607cf373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd1e168-d01e-48cd-9fab-49ac607cf373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc521c68-aeaa-44e5-97ab-3afcec70c2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf33846ca64f70aff1126150a419ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:22Z,use_quota=True,user_id='7366785ac8d44a1d98e6930e327fdd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44aa2b7f-3668-4edc-97a4-f13b801dab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44aa2b7f-3668-4edc-97a4-f13b801dab06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbf9e89-b464-4671-be33-fb57455d393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbf9e89-b464-4671-be33-fb57455d393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc521c68-aeaa-44e5-97ab-3afcec70c2b6', 'volume_name': 'volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc48a83-1ecf-418a-8184-edaf26d0a3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc48a83-1ecf-418a-8184-edaf26d0a3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04230609-cfd7-4d4d-953d-f70a83ea4adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Volume dc521c68-aeaa-44e5-97ab-3afcec70c2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6', 'volume_size': 1}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc521c68-aeaa-44e5-97ab-3afcec70c2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf33846ca64f70aff1126150a419ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:22Z,use_quota=True,user_id='7366785ac8d44a1d98e6930e327fdd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Creating volume dc521c68-aeaa-44e5-97ab-3afcec70c2b6 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:22 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:22 devstack sudo[87610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6 1073741824
Apr 15 16:32:22 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Flow 'volume_create_manager' (f809091c-c1b0-4a77-886f-62300ac410ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7572a1-7f53-45a4-b566-e6e1250fe085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7572a1-7f53-45a4-b566-e6e1250fe085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1683599438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b076987-3119-4f7f-8182-4e71f404c604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf126fc06674a7a9f3bbdb26f6a0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:22Z,use_quota=True,user_id='d2b8cdcb6fa4424f80b2b0a5b80621f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0846ea40-9613-405d-a96d-ca46f1a69298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0846ea40-9613-405d-a96d-ca46f1a69298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb12eca-5626-42d5-a24a-17b0bd8f70d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb12eca-5626-42d5-a24a-17b0bd8f70d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b076987-3119-4f7f-8182-4e71f404c604', 'volume_name': 'volume-8b076987-3119-4f7f-8182-4e71f404c604', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb647e8-a59d-470f-b63f-a8de3d009452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb647e8-a59d-470f-b63f-a8de3d009452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fc4012-a7ec-4b05-ba3e-99eff25e7c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:22 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Volume 8b076987-3119-4f7f-8182-4e71f404c604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b076987-3119-4f7f-8182-4e71f404c604', 'volume_size': 1}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-14bef25a-04b9-4205-9628-d6618fbbd857 tempest-VolumesActionsTest-594480100 None] Acquiring lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce" by "attach_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-14bef25a-04b9-4205-9628-d6618fbbd857 tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce" acquired by "attach_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-14bef25a-04b9-4205-9628-d6618fbbd857 tempest-VolumesActionsTest-594480100 None] Attaching volume dd64687e-c0e8-4e93-9485-0f962c245bce to instance 036ac235-406d-4353-b5fb-3553f7e4c2fe at mountpoint /dev/vdb on host None.
Apr 15 16:32:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-14bef25a-04b9-4205-9628-d6618fbbd857 tempest-VolumesActionsTest-594480100 None] Attach volume completed successfully.
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-14bef25a-04b9-4205-9628-d6618fbbd857 tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce" released by "attach_volume" :: held 0.063s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:22 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6 1073741824" returned: 0 in 0.645s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:22 devstack sudo[87616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6
Apr 15 16:32:22 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-03c198fa-9f50-4d72-ac9b-f3a13557c63b tempest-VolumesActionsTest-594480100 None] Acquiring lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce-detach_volume" by "detach_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-03c198fa-9f50-4d72-ac9b-f3a13557c63b tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-03c198fa-9f50-4d72-ac9b-f3a13557c63b tempest-VolumesActionsTest-594480100 None] Detaching volume dd64687e-c0e8-4e93-9485-0f962c245bce from instance 036ac235-406d-4353-b5fb-3553f7e4c2fe.
Apr 15 16:32:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-03c198fa-9f50-4d72-ac9b-f3a13557c63b tempest-VolumesActionsTest-594480100 None] Detach volume completed successfully.
Apr 15 16:32:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-03c198fa-9f50-4d72-ac9b-f3a13557c63b tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:23 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6" returned: 0 in 0.457s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1683599438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b076987-3119-4f7f-8182-4e71f404c604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf126fc06674a7a9f3bbdb26f6a0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:22Z,use_quota=True,user_id='d2b8cdcb6fa4424f80b2b0a5b80621f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Creating volume 8b076987-3119-4f7f-8182-4e71f404c604 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:23 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04230609-cfd7-4d4d-953d-f70a83ea4adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738e9ec2-1780-4779-897b-e7edaf600d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:23 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604 1073741824
Apr 15 16:32:23 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:23 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Volume volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6 (dc521c68-aeaa-44e5-97ab-3afcec70c2b6): created successfully
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738e9ec2-1780-4779-897b-e7edaf600d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Flow 'volume_create_manager' (7fd4cbe4-cc29-4b4b-b379-b49f1056297f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:23 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b277c9f5-f289-47b4-b463-3647e0adeab1 tempest-CinderUnicodeTest-2143672558 None] Created volume successfully.
Apr 15 16:32:23 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604 1073741824" returned: 0 in 0.629s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:23 devstack sudo[87626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604
Apr 15 16:32:23 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:24 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604" returned: 0 in 0.453s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fc4012-a7ec-4b05-ba3e-99eff25e7c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b076987-3119-4f7f-8182-4e71f404c604', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45a1ced9-7f3f-41d2-adf7-99d5eaa02cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:24 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Volume volume-8b076987-3119-4f7f-8182-4e71f404c604 (8b076987-3119-4f7f-8182-4e71f404c604): created successfully
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45a1ced9-7f3f-41d2-adf7-99d5eaa02cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Flow 'volume_create_manager' (f809091c-c1b0-4a77-886f-62300ac410ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:24 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-0ec0a218-77af-45ff-9941-208a3f5ca65f tempest-VolumesExtendTest-1587287090 None] Created volume successfully.
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Flow 'volume_create_manager' (a93b0e51-cc92-433d-a90c-9f0a99988ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2185d82e-25bb-462f-86e4-97a3804a7bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2185d82e-25bb-462f-86e4-97a3804a7bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1751198577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff05220d-d49e-4a0e-ad8b-684f4d3e69bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf33846ca64f70aff1126150a419ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:24Z,use_quota=True,user_id='7366785ac8d44a1d98e6930e327fdd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da280e41-8402-44dc-97cc-02949f2cf340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da280e41-8402-44dc-97cc-02949f2cf340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cd3a80-a845-4582-8c1e-d44901c2a31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cd3a80-a845-4582-8c1e-d44901c2a31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff05220d-d49e-4a0e-ad8b-684f4d3e69bd', 'volume_name': 'volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542447a6-1ec3-447c-ae8a-a7d696e8d97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542447a6-1ec3-447c-ae8a-a7d696e8d97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8954059b-cba2-4277-b78f-a678d0fcaf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:24 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Volume ff05220d-d49e-4a0e-ad8b-684f4d3e69bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd', 'volume_size': 1}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1751198577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff05220d-d49e-4a0e-ad8b-684f4d3e69bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf33846ca64f70aff1126150a419ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:24Z,use_quota=True,user_id='7366785ac8d44a1d98e6930e327fdd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Creating volume ff05220d-d49e-4a0e-ad8b-684f4d3e69bd {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:24 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:24 devstack sudo[87630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd 1073741824
Apr 15 16:32:24 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:25 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd 1073741824" returned: 0 in 0.606s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:25 devstack sudo[87661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd
Apr 15 16:32:25 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:25 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" returned: 0 in 0.443s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.330s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8954059b-cba2-4277-b78f-a678d0fcaf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecbe542-4bd6-437b-bb9b-ca1fd44f6305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Creating offline snapshot 8077125c-50b6-46e7-96cc-577ba3c6474b of volume 8b076987-3119-4f7f-8182-4e71f404c604 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:32:25 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Volume volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd (ff05220d-d49e-4a0e-ad8b-684f4d3e69bd): created successfully
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecbe542-4bd6-437b-bb9b-ca1fd44f6305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Flow 'volume_create_manager' (a93b0e51-cc92-433d-a90c-9f0a99988ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f96c3c-b180-4412-8026-3009460d177f]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:25 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-360f3355-4413-4843-ad65-a082805e0ae4 tempest-CinderUnicodeTest-2143672558 None] Created volume successfully.
Apr 15 16:32:25 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604
Apr 15 16:32:25 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:26 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604" returned: 0 in 0.515s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:26 devstack sudo[87670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b 1G
Apr 15 16:32:26 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:26 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b 1G" returned: 0 in 0.601s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b076987-3119-4f7f-8182-4e71f404c604 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:26 devstack sudo[87676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b076987-3119-4f7f-8182-4e71f404c604 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b
Apr 15 16:32:26 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:27 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b076987-3119-4f7f-8182-4e71f404c604 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b" returned: 0 in 0.487s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:27 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b is being set with open permissions: ugo+rw
Apr 15 16:32:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:27 devstack sudo[87681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b
Apr 15 16:32:27 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:27 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b" returned: 0 in 0.434s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:27 devstack sudo[87685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.info
Apr 15 16:32:27 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:28 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.info" returned: 0 in 0.469s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:28 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.info is being set with open permissions: ugo+rw
Apr 15 16:32:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:28 devstack sudo[87688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.info
Apr 15 16:32:28 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:28 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.info" returned: 0 in 0.513s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.107s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.842s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Creating offline snapshot bd3332f5-bab4-4160-9e3b-7faa5b79e48c of volume ff05220d-d49e-4a0e-ad8b-684f4d3e69bd {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:32:28 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-91a85f2c-146f-42c5-a659-d75ecd59de9b tempest-VolumesExtendTest-1587287090 None] Create snapshot completed successfully
Apr 15 16:32:28 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3c7cad-37a6-4ed1-bcdc-cfc93eedc3a1]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:28 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd
Apr 15 16:32:28 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:29 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" returned: 0 in 0.521s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:29 devstack sudo[87704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c 1G
Apr 15 16:32:29 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-36a4c122-730b-41ac-bb42-5a66e0e8390e tempest-VolumesExtendTest-1587287090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:29 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c 1G" returned: 0 in 0.614s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:29 devstack sudo[87709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c
Apr 15 16:32:29 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:30 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c" returned: 0 in 0.510s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:30 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c is being set with open permissions: ugo+rw
Apr 15 16:32:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:30 devstack sudo[87714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c
Apr 15 16:32:30 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:30 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c" returned: 0 in 0.509s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:30 devstack sudo[87717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.info
Apr 15 16:32:30 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Acquiring lock "cinder-86a645ff-028c-4949-b88c-73c27b4bc05e-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Lock "cinder-86a645ff-028c-4949-b88c-73c27b4bc05e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Acquiring lock "cinder-quobyte-86a645ff-028c-4949-b88c-73c27b4bc05e" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Lock "cinder-quobyte-86a645ff-028c-4949-b88c-73c27b4bc05e" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13942f8-6030-4509-862b-547e9588d4c3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:31 devstack sudo[87719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e
Apr 15 16:32:31 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:31 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.info" returned: 0 in 0.460s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:31 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.info is being set with open permissions: ugo+rw
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:31 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.info
Apr 15 16:32:31 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:31 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e" returned: 0 in 0.555s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:31 devstack sudo[87730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e
Apr 15 16:32:31 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:31 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.info" returned: 0 in 0.464s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.171s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-36a4c122-730b-41ac-bb42-5a66e0e8390e tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.342s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b968e4-937c-44d4-bbc2-047f1842f23a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-36a4c122-730b-41ac-bb42-5a66e0e8390e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e990d363-113c-483b-aa27-37a83bebe515 tempest-CinderUnicodeTest-2143672558 None] Create snapshot completed successfully
Apr 15 16:32:31 devstack sudo[87733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604
Apr 15 16:32:31 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "cinder-bd3332f5-bab4-4160-9e3b-7faa5b79e48c-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-bd3332f5-bab4-4160-9e3b-7faa5b79e48c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "cinder-quobyte-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-quobyte-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "cinder-quobyte-bd3332f5-bab4-4160-9e3b-7faa5b79e48c" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-quobyte-bd3332f5-bab4-4160-9e3b-7faa5b79e48c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Deleting offline snapshot bd3332f5-bab4-4160-9e3b-7faa5b79e48c of volume ff05220d-d49e-4a0e-ad8b-684f4d3e69bd {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] snapshot_file for this snap is: volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93d8ab0-7c60-46b0-b787-7048c7cf1d43]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:32 devstack sudo[87736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c
Apr 15 16:32:32 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:32 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-86a645ff-028c-4949-b88c-73c27b4bc05e" returned: 0 in 0.442s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Lock "cinder-quobyte-86a645ff-028c-4949-b88c-73c27b4bc05e" released by "delete_volume" :: held 1.022s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Created reservations ['4cf44529-4919-4136-a804-100400286073', '9f938258-54c1-4ffe-bfc2-980c0ffda7ca', '1888670c-bce3-42a6-879b-8e45372d31a7', '94044385-fd0d-4e86-abd8-a238ea11e5a5'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:32 devstack sudo[87739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:32 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:32 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-36a4c122-730b-41ac-bb42-5a66e0e8390e tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604" returned: 0 in 0.554s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-36a4c122-730b-41ac-bb42-5a66e0e8390e tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b 2G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-36a4c122-730b-41ac-bb42-5a66e0e8390e tempest-VolumesExtendTest-1587287090 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b 2G" returned: 0 in 0.072s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-36a4c122-730b-41ac-bb42-5a66e0e8390e tempest-VolumesExtendTest-1587287090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.644s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:32 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-36a4c122-730b-41ac-bb42-5a66e0e8390e tempest-VolumesExtendTest-1587287090 None] Extend volume completed successfully.
Apr 15 16:32:32 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c" returned: 0 in 0.564s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d2673-f165-4a0e-8e16-71cbf721ec38]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:32 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.443s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:32 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Deleted volume successfully.
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f443c1e3-ab9b-414b-bcba-c1f364be62d7 tempest-VolumesNegativeTest-1406197163 None] Lock "cinder-86a645ff-028c-4949-b88c-73c27b4bc05e-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:32 devstack sudo[87751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd
Apr 15 16:32:32 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Acquiring lock "cinder-8077125c-50b6-46e7-96cc-577ba3c6474b-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Lock "cinder-8077125c-50b6-46e7-96cc-577ba3c6474b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Acquiring lock "cinder-quobyte-8b076987-3119-4f7f-8182-4e71f404c604" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Lock "cinder-quobyte-8b076987-3119-4f7f-8182-4e71f404c604" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Acquiring lock "cinder-quobyte-8077125c-50b6-46e7-96cc-577ba3c6474b" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Lock "cinder-quobyte-8077125c-50b6-46e7-96cc-577ba3c6474b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Deleting offline snapshot 8077125c-50b6-46e7-96cc-577ba3c6474b of volume 8b076987-3119-4f7f-8182-4e71f404c604 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] snapshot_file for this snap is: volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[77643767-82d5-4139-b643-32289365fbae]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:32 devstack sudo[87753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b
Apr 15 16:32:32 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:33 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" returned: 0 in 0.502s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:33 devstack sudo[87759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c
Apr 15 16:32:33 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:33 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b" returned: 0 in 0.479s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b076987-3119-4f7f-8182-4e71f404c604(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a3d2d-aee2-4b07-bd20-b0f73e7158f4]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:33 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604
Apr 15 16:32:33 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:33 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c" returned: 0 in 0.552s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:33 devstack sudo[87771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c
Apr 15 16:32:33 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:33 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604" returned: 0 in 0.525s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:33 devstack sudo[87773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b
Apr 15 16:32:33 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:34 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd.bd3332f5-bab4-4160-9e3b-7faa5b79e48c" returned: 0 in 0.510s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-quobyte-bd3332f5-bab4-4160-9e3b-7faa5b79e48c" released by "_delete_snapshot" :: held 2.210s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-quobyte-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" released by "delete_snapshot" :: held 2.224s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Created reservations ['deb82a4a-5088-4bd8-9f97-4b12184ecef7', '39db7c8c-586b-4fc1-9448-1be47abb8356', 'dce68983-3b5b-402f-8fd4-cb6be8bea7f9', '1feb4838-472e-48d0-a701-4af9b424bd55'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:34 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Delete snapshot completed successfully.
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a7fea115-3cb6-4a7c-ae0a-d0ead12f3640 tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-bd3332f5-bab4-4160-9e3b-7faa5b79e48c-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:34 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b" returned: 0 in 0.566s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:34 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b
Apr 15 16:32:34 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (a6e276d4-85e2-4a95-ab52-21b720545851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a1d06a-5bfd-4fbd-8865-14653c124b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a1d06a-5bfd-4fbd-8865-14653c124b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270887373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15ad3de-2b89-45ff-8ddc-b705611faef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:35Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1989a7a4-d4d9-4e21-b95c-0668954925c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:34 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1989a7a4-d4d9-4e21-b95c-0668954925c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c89729-4478-45f1-b207-35b0663da350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c89729-4478-45f1-b207-35b0663da350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15ad3de-2b89-45ff-8ddc-b705611faef0', 'volume_name': 'volume-b15ad3de-2b89-45ff-8ddc-b705611faef0', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134343a2-7ea1-4dfb-aa77-c7bfcf07d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134343a2-7ea1-4dfb-aa77-c7bfcf07d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4725dac7-96a8-4391-9e1d-44fd5142baef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:34 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Volume b15ad3de-2b89-45ff-8ddc-b705611faef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15ad3de-2b89-45ff-8ddc-b705611faef0', 'volume_size': 1}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270887373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15ad3de-2b89-45ff-8ddc-b705611faef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:35Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Creating volume b15ad3de-2b89-45ff-8ddc-b705611faef0 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:34 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604.8077125c-50b6-46e7-96cc-577ba3c6474b" returned: 0 in 0.533s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:34 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0 1073741824
Apr 15 16:32:34 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Lock "cinder-quobyte-8077125c-50b6-46e7-96cc-577ba3c6474b" released by "_delete_snapshot" :: held 2.199s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Lock "cinder-quobyte-8b076987-3119-4f7f-8182-4e71f404c604" released by "delete_snapshot" :: held 2.209s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (2ee26072-a03b-43fc-a8f8-c0d91908d095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1548545-251f-4c02-90c7-3b84dff7199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Created reservations ['9d9a7c5e-bcbb-4c7b-916f-8e51fcb20dbb', 'f0b16647-903a-4ce5-9a55-74b9739f9acd', 'a8512534-65bc-43b0-a861-fe3785501f7a', 'b4fc6f84-671b-4954-a0bb-fa6642330971'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1548545-251f-4c02-90c7-3b84dff7199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-120809660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547f733a-e3aa-4044-a425-5640fb25a2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:35Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4606f15b-fa7f-4a61-875b-cfecdbdc1fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4606f15b-fa7f-4a61-875b-cfecdbdc1fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe67add-755c-42e3-a4e9-01fdb0755e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe67add-755c-42e3-a4e9-01fdb0755e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '547f733a-e3aa-4044-a425-5640fb25a2d2', 'volume_name': 'volume-547f733a-e3aa-4044-a425-5640fb25a2d2', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bb8dbf-b421-4645-b0a8-d574f49da8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bb8dbf-b421-4645-b0a8-d574f49da8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1fd6bb-a61f-427e-8f7f-aacd3c905c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Volume 547f733a-e3aa-4044-a425-5640fb25a2d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-547f733a-e3aa-4044-a425-5640fb25a2d2', 'volume_size': 1}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:35 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Delete snapshot completed successfully.
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-72dacfea-f477-4dfe-85e5-5d06b8f71fdf tempest-VolumesExtendTest-1587287090 None] Lock "cinder-8077125c-50b6-46e7-96cc-577ba3c6474b-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "cinder-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "cinder-quobyte-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-quobyte-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6195f5a8-bea5-4c52-9c8b-733a2a0789b7]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:35 devstack sudo[87818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd
Apr 15 16:32:35 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (88974c5b-887c-40a0-a923-fcdd3c3a54a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819019a3-4720-4abe-8b99-c53194d758d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819019a3-4720-4abe-8b99-c53194d758d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-393871712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081fb353-2401-49f0-8dea-89baffb596bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:35Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a25e3a-8f67-4fcc-b722-cefa6f4565ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a25e3a-8f67-4fcc-b722-cefa6f4565ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5937300e-6128-4367-931a-50a947bd7b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5937300e-6128-4367-931a-50a947bd7b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081fb353-2401-49f0-8dea-89baffb596bf', 'volume_name': 'volume-081fb353-2401-49f0-8dea-89baffb596bf', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62483e3e-1ef0-4cfb-9d0a-821fcf9b5c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62483e3e-1ef0-4cfb-9d0a-821fcf9b5c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747f6711-b8dd-4c92-ae71-cdfe4a1bc51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Volume 081fb353-2401-49f0-8dea-89baffb596bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081fb353-2401-49f0-8dea-89baffb596bf', 'volume_size': 1}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:35 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0 1073741824" returned: 0 in 0.597s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:35 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0
Apr 15 16:32:35 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (48bdedda-4d20-478c-93a4-5c2423163026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf67bee-4fa7-4f4f-86a1-7b2452b37861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf67bee-4fa7-4f4f-86a1-7b2452b37861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-560681920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8262aa20-a63b-4124-b80e-b0de80371abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:36Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f706fb05-ec13-4465-86e9-f190b6351090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f706fb05-ec13-4465-86e9-f190b6351090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b935fbb0-0807-4625-8cf0-c3f225db9177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b935fbb0-0807-4625-8cf0-c3f225db9177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8262aa20-a63b-4124-b80e-b0de80371abf', 'volume_name': 'volume-8262aa20-a63b-4124-b80e-b0de80371abf', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1caa7e1c-7a07-451c-b880-28eb942f3caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1caa7e1c-7a07-451c-b880-28eb942f3caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248a6674-8b34-4ae7-839a-fc15d615178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Volume 8262aa20-a63b-4124-b80e-b0de80371abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8262aa20-a63b-4124-b80e-b0de80371abf', 'volume_size': 1}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (0ecda9df-01bc-4665-8cba-b935bd83a2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c760667-407c-473d-bce8-26e96335d703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c760667-407c-473d-bce8-26e96335d703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-35282671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8856bc7a-eb87-4a62-adf4-a7a2640b99a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:36Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5177620-b75a-4e70-955d-d4d2c2f15ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5177620-b75a-4e70-955d-d4d2c2f15ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8994365b-92d4-4655-9ad4-6f25a2762769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8994365b-92d4-4655-9ad4-6f25a2762769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8856bc7a-eb87-4a62-adf4-a7a2640b99a8', 'volume_name': 'volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b07cd3-dba5-495e-8197-82e10db1b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b07cd3-dba5-495e-8197-82e10db1b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d354bd-2951-4608-b440-26adb902aeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:35 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Volume 8856bc7a-eb87-4a62-adf4-a7a2640b99a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8', 'volume_size': 1}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:35 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" returned: 0 in 0.605s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:35 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd
Apr 15 16:32:35 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Acquiring lock "cinder-8b076987-3119-4f7f-8182-4e71f404c604-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Lock "cinder-8b076987-3119-4f7f-8182-4e71f404c604-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Acquiring lock "cinder-quobyte-8b076987-3119-4f7f-8182-4e71f404c604" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Lock "cinder-quobyte-8b076987-3119-4f7f-8182-4e71f404c604" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[37295e54-1a2f-40e7-9bc0-fa95353e9423]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:36 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0" returned: 0 in 0.582s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-120809660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547f733a-e3aa-4044-a425-5640fb25a2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:35Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Creating volume 547f733a-e3aa-4044-a425-5640fb25a2d2 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:36 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:36 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604
Apr 15 16:32:36 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4725dac7-96a8-4391-9e1d-44fd5142baef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15ad3de-2b89-45ff-8ddc-b705611faef0', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a4e010-9416-4845-ad86-a9e5a871a8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:36 devstack sudo[87832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2 1073741824
Apr 15 16:32:36 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Volume volume-b15ad3de-2b89-45ff-8ddc-b705611faef0 (b15ad3de-2b89-45ff-8ddc-b705611faef0): created successfully
Apr 15 16:32:36 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a4e010-9416-4845-ad86-a9e5a871a8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (a6e276d4-85e2-4a95-ab52-21b720545851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:36 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-4847ca2c-a3d5-425f-b4e3-b231c237d99e tempest-CreateVolumesFromImageTest-1027758947 None] Created volume successfully.
Apr 15 16:32:36 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" returned: 0 in 0.709s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-quobyte-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd" released by "delete_volume" :: held 1.354s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Created reservations ['46701065-aefb-4db4-8c2f-2041302c058b', '4a245c67-f827-4c28-a652-2d03412859ad', 'c99616a2-aa62-426a-9035-e835a7666a5f', '7d4a7b6b-a9b3-46e6-bee7-beb502753328'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:36 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604" returned: 0 in 0.624s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:36 devstack sudo[87839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:36 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:36 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604
Apr 15 16:32:36 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:36 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2 1073741824" returned: 0 in 0.818s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:37 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2
Apr 15 16:32:37 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:37 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Deleted volume successfully.
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-57babb92-7323-40ab-b6a7-d24a893b3deb tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-ff05220d-d49e-4a0e-ad8b-684f4d3e69bd-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:37 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8b076987-3119-4f7f-8182-4e71f404c604" returned: 0 in 0.591s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Lock "cinder-quobyte-8b076987-3119-4f7f-8182-4e71f404c604" released by "delete_volume" :: held 1.245s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Created reservations ['47804b8f-4699-4bcf-b07e-fe4b8b477c1b', '8ccea8a0-9fb7-439b-bd32-5ca7aca247a6', 'f42efaca-b30a-455e-8648-40737d2267bb', '480ca2de-4181-4962-a83c-265b2cdd2a38'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "cinder-dc521c68-aeaa-44e5-97ab-3afcec70c2b6-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:37 devstack sudo[87851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:37 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-dc521c68-aeaa-44e5-97ab-3afcec70c2b6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "cinder-quobyte-dc521c68-aeaa-44e5-97ab-3afcec70c2b6" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-quobyte-dc521c68-aeaa-44e5-97ab-3afcec70c2b6" acquired by "delete_volume" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[21afadc4-2d2a-4c67-a09d-68e9750f4b1e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:37 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2" returned: 0 in 0.533s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.089s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-393871712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081fb353-2401-49f0-8dea-89baffb596bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:35Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Creating volume 081fb353-2401-49f0-8dea-89baffb596bf {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:37 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1fd6bb-a61f-427e-8f7f-aacd3c905c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-547f733a-e3aa-4044-a425-5640fb25a2d2', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:37 devstack sudo[87856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf 1073741824
Apr 15 16:32:37 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:37 devstack sudo[87855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6
Apr 15 16:32:37 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6c79c1-b966-4959-9988-ddfea7ab2fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:37 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Volume volume-547f733a-e3aa-4044-a425-5640fb25a2d2 (547f733a-e3aa-4044-a425-5640fb25a2d2): created successfully
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6c79c1-b966-4959-9988-ddfea7ab2fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (2ee26072-a03b-43fc-a8f8-c0d91908d095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-40618604-e77a-436e-a6a2-a8e67efa9232 tempest-CreateVolumesFromImageTest-1027758947 None] Created volume successfully.
Apr 15 16:32:37 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.483s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Deleted volume successfully.
Apr 15 16:32:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-83f4aa6e-1eb7-40e7-93c8-85083f88d51a tempest-VolumesExtendTest-1587287090 None] Lock "cinder-8b076987-3119-4f7f-8182-4e71f404c604-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:38 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6" returned: 0 in 0.593s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:38 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6
Apr 15 16:32:38 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:38 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf 1073741824" returned: 0 in 0.587s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:38 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf
Apr 15 16:32:38 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:38 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dc521c68-aeaa-44e5-97ab-3afcec70c2b6" returned: 0 in 0.449s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-quobyte-dc521c68-aeaa-44e5-97ab-3afcec70c2b6" released by "delete_volume" :: held 1.065s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Created reservations ['46affc8e-14a0-4601-bf7b-4ff791f9a407', 'a1a61d1e-e302-4597-93b2-a74ed489b376', 'dd34e90c-70bf-47e4-8512-1067f1774282', 'a2b513c1-2a1a-4b74-bcf7-81cba8bcfecf'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:38 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf" returned: 0 in 0.502s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.010s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-560681920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8262aa20-a63b-4124-b80e-b0de80371abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:36Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Creating volume 8262aa20-a63b-4124-b80e-b0de80371abf {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:38 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:38 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:38 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747f6711-b8dd-4c92-ae71-cdfe4a1bc51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081fb353-2401-49f0-8dea-89baffb596bf', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:38 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf 1073741824
Apr 15 16:32:38 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdf22f1-dbe1-48c9-9d0c-62bf16b6d8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:38 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Volume volume-081fb353-2401-49f0-8dea-89baffb596bf (081fb353-2401-49f0-8dea-89baffb596bf): created successfully
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdf22f1-dbe1-48c9-9d0c-62bf16b6d8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (88974c5b-887c-40a0-a923-fcdd3c3a54a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:38 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6c49de23-ab35-4e0d-a810-b0822ca81f79 tempest-CreateVolumesFromImageTest-1027758947 None] Created volume successfully.
Apr 15 16:32:39 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.459s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:39 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Deleted volume successfully.
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5087bc4e-015e-4bdd-a523-b5f809da9b9d tempest-CinderUnicodeTest-2143672558 None] Lock "cinder-dc521c68-aeaa-44e5-97ab-3afcec70c2b6-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:39 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf 1073741824" returned: 0 in 0.639s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:39 devstack sudo[87895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf
Apr 15 16:32:39 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:39 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf" returned: 0 in 0.486s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.941s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-35282671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8856bc7a-eb87-4a62-adf4-a7a2640b99a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e190c239b4685b853fd0ffa2e96f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:36Z,use_quota=True,user_id='ecbcdba25bb04339954adfae17f5e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Creating volume 8856bc7a-eb87-4a62-adf4-a7a2640b99a8 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:39 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248a6674-8b34-4ae7-839a-fc15d615178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8262aa20-a63b-4124-b80e-b0de80371abf', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e0abc0-a17f-458a-8e37-d32e4b83eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:39 devstack sudo[87898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8 1073741824
Apr 15 16:32:39 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:39 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Volume volume-8262aa20-a63b-4124-b80e-b0de80371abf (8262aa20-a63b-4124-b80e-b0de80371abf): created successfully
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e0abc0-a17f-458a-8e37-d32e4b83eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (48bdedda-4d20-478c-93a4-5c2423163026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:39 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6de54fe3-2186-4b79-8fbb-1ca976e97cbd tempest-CreateVolumesFromImageTest-1027758947 None] Created volume successfully.
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Flow 'volume_create_manager' (02165103-90d4-4b2b-92a3-57f0b39f9ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d2dbfe-138d-49d6-8122-380536964e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d2dbfe-138d-49d6-8122-380536964e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-846241841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cda74f0-0fae-4a71-b1df-4976318be0af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d11cc89704244e4be4509bac0891905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:40Z,use_quota=True,user_id='623e8bf3ab9e4083b1d12bd46dc9d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b3b497-6210-4e83-b23c-5c8af17f8836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b3b497-6210-4e83-b23c-5c8af17f8836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7e7406-2e2e-4a62-884e-014500a427a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7e7406-2e2e-4a62-884e-014500a427a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cda74f0-0fae-4a71-b1df-4976318be0af', 'volume_name': 'volume-7cda74f0-0fae-4a71-b1df-4976318be0af', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cbabe8-de75-4c88-a2f9-e928f8241ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cbabe8-de75-4c88-a2f9-e928f8241ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846813bf-a0ea-4115-b517-8bd7ba2520c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Volume 7cda74f0-0fae-4a71-b1df-4976318be0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cda74f0-0fae-4a71-b1df-4976318be0af', 'volume_size': 1}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:40 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8 1073741824" returned: 0 in 0.627s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:40 devstack sudo[87903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8
Apr 15 16:32:40 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:40 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8" returned: 0 in 0.417s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-846241841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cda74f0-0fae-4a71-b1df-4976318be0af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d11cc89704244e4be4509bac0891905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:40Z,use_quota=True,user_id='623e8bf3ab9e4083b1d12bd46dc9d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Creating volume 7cda74f0-0fae-4a71-b1df-4976318be0af {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:40 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d354bd-2951-4608-b440-26adb902aeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:40 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af 1073741824
Apr 15 16:32:40 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f9af54-ac5d-4c2a-9f74-608cd6d45531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Volume volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8 (8856bc7a-eb87-4a62-adf4-a7a2640b99a8): created successfully
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f9af54-ac5d-4c2a-9f74-608cd6d45531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Flow 'volume_create_manager' (0ecda9df-01bc-4665-8cba-b935bd83a2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:40 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-54101ca7-1f49-4b35-9e4e-e7dba9138ff5 tempest-CreateVolumesFromImageTest-1027758947 None] Created volume successfully.
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-8856bc7a-eb87-4a62-adf4-a7a2640b99a8-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-8856bc7a-eb87-4a62-adf4-a7a2640b99a8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-quobyte-8856bc7a-eb87-4a62-adf4-a7a2640b99a8" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-8856bc7a-eb87-4a62-adf4-a7a2640b99a8" acquired by "delete_volume" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1c2035-9b71-4d22-9600-6cd2b4f66803]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:41 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af 1073741824" returned: 0 in 0.561s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:41 devstack sudo[87915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af
Apr 15 16:32:41 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:41 devstack sudo[87914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8
Apr 15 16:32:41 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:41 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af" returned: 0 in 0.407s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846813bf-a0ea-4115-b517-8bd7ba2520c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cda74f0-0fae-4a71-b1df-4976318be0af', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dda3de5-4a93-4ffc-b683-cb41cbd42c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:41 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Volume volume-7cda74f0-0fae-4a71-b1df-4976318be0af (7cda74f0-0fae-4a71-b1df-4976318be0af): created successfully
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dda3de5-4a93-4ffc-b683-cb41cbd42c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Flow 'volume_create_manager' (02165103-90d4-4b2b-92a3-57f0b39f9ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:41 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:41 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-be4dbe12-a1aa-452f-82cf-fdfc58721fdf tempest-VolumesListTestJSON-1196198714 None] Created volume successfully.
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8" returned: 0 in 0.499s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:41 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8
Apr 15 16:32:41 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:42 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8856bc7a-eb87-4a62-adf4-a7a2640b99a8" returned: 0 in 0.639s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-8856bc7a-eb87-4a62-adf4-a7a2640b99a8" released by "delete_volume" :: held 1.161s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Created reservations ['bdae013f-6d57-4fef-b735-986227662d45', '19786e89-6c2a-4475-858f-87e112b52cae', 'f4340e01-c937-4650-9de6-061cb6641de6', '176179f7-573e-4b13-a7b8-7322d3fc04e1'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:42 devstack sudo[87952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:42 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Flow 'volume_create_manager' (917c1452-deea-412d-a6d9-604c1d8d1fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543692ca-d38a-49e5-8c0d-2555ce317a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543692ca-d38a-49e5-8c0d-2555ce317a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1135432616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596d95d5-9f25-41b4-89d8-9c55406de313,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d11cc89704244e4be4509bac0891905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:43Z,use_quota=True,user_id='623e8bf3ab9e4083b1d12bd46dc9d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cbd5e3-54ba-4db0-9415-ae4eb83abd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cbd5e3-54ba-4db0-9415-ae4eb83abd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e04ac4-ed2b-43df-9569-07c98ac63fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e04ac4-ed2b-43df-9569-07c98ac63fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596d95d5-9f25-41b4-89d8-9c55406de313', 'volume_name': 'volume-596d95d5-9f25-41b4-89d8-9c55406de313', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa2b119-4514-45a9-8f6f-2b944fc193d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa2b119-4514-45a9-8f6f-2b944fc193d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f40f35b-093c-4505-8439-0cd65f11764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:42 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Volume 596d95d5-9f25-41b4-89d8-9c55406de313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596d95d5-9f25-41b4-89d8-9c55406de313', 'volume_size': 1}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1135432616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596d95d5-9f25-41b4-89d8-9c55406de313,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d11cc89704244e4be4509bac0891905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:43Z,use_quota=True,user_id='623e8bf3ab9e4083b1d12bd46dc9d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Creating volume 596d95d5-9f25-41b4-89d8-9c55406de313 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:42 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:42 devstack sudo[87955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313 1073741824
Apr 15 16:32:42 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:43 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.524s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:43 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Deleted volume successfully.
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cf7685e-0f8b-422e-91c5-d1abf8428314 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-8856bc7a-eb87-4a62-adf4-a7a2640b99a8-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:43 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313 1073741824" returned: 0 in 0.523s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:43 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313
Apr 15 16:32:43 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-8262aa20-a63b-4124-b80e-b0de80371abf-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-8262aa20-a63b-4124-b80e-b0de80371abf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-quobyte-8262aa20-a63b-4124-b80e-b0de80371abf" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-8262aa20-a63b-4124-b80e-b0de80371abf" acquired by "delete_volume" :: waited 0.020s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6ca4d2-bac1-4987-b2c2-d087e249182e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:43 devstack sudo[87963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf
Apr 15 16:32:43 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:43 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313" returned: 0 in 0.490s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f40f35b-093c-4505-8439-0cd65f11764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596d95d5-9f25-41b4-89d8-9c55406de313', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a64c4c-8e1b-469f-9697-3aaa6a7592a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:44 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Volume volume-596d95d5-9f25-41b4-89d8-9c55406de313 (596d95d5-9f25-41b4-89d8-9c55406de313): created successfully
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a64c4c-8e1b-469f-9697-3aaa6a7592a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Flow 'volume_create_manager' (917c1452-deea-412d-a6d9-604c1d8d1fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c41bb88e-4450-47df-9f19-9bdbd66b13b6 tempest-VolumesListTestJSON-1196198714 None] Created volume successfully.
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-39a70df9-0d70-4714-b64e-99bdaf0469b0 tempest-VolumesActionsTest-594480100 None] Acquiring lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce" by "attach_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-39a70df9-0d70-4714-b64e-99bdaf0469b0 tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce" acquired by "attach_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-39a70df9-0d70-4714-b64e-99bdaf0469b0 tempest-VolumesActionsTest-594480100 None] Attaching volume dd64687e-c0e8-4e93-9485-0f962c245bce to instance b7e0e195-d7c1-48d6-a158-c6bdbf3ce7ed at mountpoint /dev/vdb on host None.
Apr 15 16:32:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-39a70df9-0d70-4714-b64e-99bdaf0469b0 tempest-VolumesActionsTest-594480100 None] Attach volume completed successfully.
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-39a70df9-0d70-4714-b64e-99bdaf0469b0 tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce" released by "attach_volume" :: held 0.059s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:44 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf" returned: 0 in 0.558s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:44 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf
Apr 15 16:32:44 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:44 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-8262aa20-a63b-4124-b80e-b0de80371abf" returned: 0 in 0.491s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-8262aa20-a63b-4124-b80e-b0de80371abf" released by "delete_volume" :: held 1.077s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b3045117-d5ae-4840-80f0-c3f6946a270a tempest-VolumesActionsTest-594480100 None] Acquiring lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce-detach_volume" by "detach_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Created reservations ['c6fbf984-59be-45f9-b3d7-15b8c03c798b', 'b826c89c-3081-4059-9bde-c115c3dd719f', '5a503f73-9e79-41f9-86c8-5af893e3411d', '02a67372-8ec0-4486-b652-7b64e2a879ee'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b3045117-d5ae-4840-80f0-c3f6946a270a tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b3045117-d5ae-4840-80f0-c3f6946a270a tempest-VolumesActionsTest-594480100 None] Detaching volume dd64687e-c0e8-4e93-9485-0f962c245bce from instance b7e0e195-d7c1-48d6-a158-c6bdbf3ce7ed.
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:44 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:44 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b3045117-d5ae-4840-80f0-c3f6946a270a tempest-VolumesActionsTest-594480100 None] Detach volume completed successfully.
Apr 15 16:32:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b3045117-d5ae-4840-80f0-c3f6946a270a tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Flow 'volume_create_manager' (7a6cca2a-aa9d-4c25-a6b0-4f58ff65125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3fea8e-ad44-48d7-9c80-81757d11a1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3fea8e-ad44-48d7-9c80-81757d11a1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1808211454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aeb54e2-57de-4c1f-9643-dcca1623ca22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d11cc89704244e4be4509bac0891905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:45Z,use_quota=True,user_id='623e8bf3ab9e4083b1d12bd46dc9d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c55de29-d8d7-4b14-84ba-5dbcfba3683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c55de29-d8d7-4b14-84ba-5dbcfba3683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bdb205-0660-40bd-9d6e-746d4706e2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bdb205-0660-40bd-9d6e-746d4706e2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aeb54e2-57de-4c1f-9643-dcca1623ca22', 'volume_name': 'volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00488a1c-5aa3-4499-aca9-bd82ac3fb4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00488a1c-5aa3-4499-aca9-bd82ac3fb4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25069ece-40ad-40ca-8d8f-8ebebfe6c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:45 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Volume 6aeb54e2-57de-4c1f-9643-dcca1623ca22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22', 'volume_size': 1}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1808211454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aeb54e2-57de-4c1f-9643-dcca1623ca22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d11cc89704244e4be4509bac0891905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:45Z,use_quota=True,user_id='623e8bf3ab9e4083b1d12bd46dc9d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Creating volume 6aeb54e2-57de-4c1f-9643-dcca1623ca22 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:32:45 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:45 devstack sudo[87975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22 1073741824
Apr 15 16:32:45 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:45 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.459s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:45 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Deleted volume successfully.
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-71d25ff1-d540-45cb-a759-eaa3fac75f8d tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-8262aa20-a63b-4124-b80e-b0de80371abf-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-081fb353-2401-49f0-8dea-89baffb596bf-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-081fb353-2401-49f0-8dea-89baffb596bf-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:45 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22 1073741824" returned: 0 in 0.568s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-quobyte-081fb353-2401-49f0-8dea-89baffb596bf" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-081fb353-2401-49f0-8dea-89baffb596bf" acquired by "delete_volume" :: waited 0.032s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:45 devstack sudo[87981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22
Apr 15 16:32:45 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec5d1b-0cb7-4383-8a5e-7b18312cb1e5]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:46 devstack sudo[87983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf
Apr 15 16:32:46 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:46 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25069ece-40ad-40ca-8d8f-8ebebfe6c6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431fa753-ca65-49d9-ab3a-3d44c398fa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:46 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Volume volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22 (6aeb54e2-57de-4c1f-9643-dcca1623ca22): created successfully
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431fa753-ca65-49d9-ab3a-3d44c398fa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Flow 'volume_create_manager' (7a6cca2a-aa9d-4c25-a6b0-4f58ff65125e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:46 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2f9ba405-041f-41e2-8cef-970338d48222 tempest-VolumesListTestJSON-1196198714 None] Created volume successfully.
Apr 15 16:32:46 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf" returned: 0 in 0.501s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:46 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf
Apr 15 16:32:46 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:46 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-081fb353-2401-49f0-8dea-89baffb596bf" returned: 0 in 0.451s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-081fb353-2401-49f0-8dea-89baffb596bf" released by "delete_volume" :: held 0.976s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Created reservations ['5f6d7e8d-c95f-4912-8cb8-91c9e051990c', 'afe28338-c570-41a8-8d31-9f6d005bad54', '19ac9811-083a-4353-a917-43bb7b799faa', '5ce571c4-f925-48bd-920b-efd8d9aa7e8f'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:46 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:46 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:47 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:47 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:47 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Deleted volume successfully.
Apr 15 16:32:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-397507b8-f85a-4f36-a747-bcd7b88c8344 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-081fb353-2401-49f0-8dea-89baffb596bf-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-547f733a-e3aa-4044-a425-5640fb25a2d2-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-547f733a-e3aa-4044-a425-5640fb25a2d2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-quobyte-547f733a-e3aa-4044-a425-5640fb25a2d2" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-547f733a-e3aa-4044-a425-5640fb25a2d2" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdcc85f-fc95-4ff6-92ed-91edf42b2319]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:48 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2
Apr 15 16:32:48 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:48 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2" returned: 0 in 0.558s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:48 devstack sudo[88033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2
Apr 15 16:32:48 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "cinder-6aeb54e2-57de-4c1f-9643-dcca1623ca22-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-6aeb54e2-57de-4c1f-9643-dcca1623ca22-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "cinder-quobyte-6aeb54e2-57de-4c1f-9643-dcca1623ca22" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-quobyte-6aeb54e2-57de-4c1f-9643-dcca1623ca22" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6e4fdb-7735-412e-8015-d212f5dbf205]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:49 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22
Apr 15 16:32:49 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:49 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-547f733a-e3aa-4044-a425-5640fb25a2d2" returned: 0 in 0.439s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-547f733a-e3aa-4044-a425-5640fb25a2d2" released by "delete_volume" :: held 1.033s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Created reservations ['e0a7c779-4f9b-4aff-a79b-f4173094b96d', '12b67a5d-d090-438d-892d-a2350eb4e003', '83922d55-8a23-4138-93eb-7eb3a4dca28f', 'fa5cde9b-3772-464c-8c68-07a7fcdf54e6'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:49 devstack sudo[88038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:49 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:49 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22" returned: 0 in 0.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:49 devstack sudo[88043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22
Apr 15 16:32:49 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:49 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.483s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:49 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Deleted volume successfully.
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-012743eb-dd82-4dd3-b040-9bed6a987006 tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-547f733a-e3aa-4044-a425-5640fb25a2d2-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:49 devstack sudo[88046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:49 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:49 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6aeb54e2-57de-4c1f-9643-dcca1623ca22" returned: 0 in 0.422s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-quobyte-6aeb54e2-57de-4c1f-9643-dcca1623ca22" released by "delete_volume" :: held 0.914s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Created reservations ['df6fd0d4-1d45-4632-a425-598da832140e', '35235d2c-db13-48c6-bd34-e9fb3e64c062', '2f7f9054-82ef-41e6-876d-5e2206a681a0', '0c643259-9cd2-44fb-89d5-aedb004b165b'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:50 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:50 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "cinder-596d95d5-9f25-41b4-89d8-9c55406de313-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-596d95d5-9f25-41b4-89d8-9c55406de313-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "cinder-quobyte-596d95d5-9f25-41b4-89d8-9c55406de313" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-quobyte-596d95d5-9f25-41b4-89d8-9c55406de313" acquired by "delete_volume" :: waited 0.020s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4387cd5d-9dd1-482c-a0f1-0d7ff3daf623]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-b15ad3de-2b89-45ff-8ddc-b705611faef0-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-b15ad3de-2b89-45ff-8ddc-b705611faef0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:50 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "cinder-quobyte-b15ad3de-2b89-45ff-8ddc-b705611faef0" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:50 devstack sudo[88051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.487s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:50 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-b15ad3de-2b89-45ff-8ddc-b705611faef0" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66addb0-4f2a-4df2-8e5d-0ab7e9c8970d]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:50 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0
Apr 15 16:32:50 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:50 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:50 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Deleted volume successfully.
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-66107b03-5f51-4ba5-bd03-2f30f0fb7c9f tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-6aeb54e2-57de-4c1f-9643-dcca1623ca22-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:50 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313" returned: 0 in 0.570s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:50 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313
Apr 15 16:32:50 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:50 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0" returned: 0 in 0.527s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:50 devstack sudo[88065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0
Apr 15 16:32:50 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:51 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-596d95d5-9f25-41b4-89d8-9c55406de313" returned: 0 in 0.422s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-quobyte-596d95d5-9f25-41b4-89d8-9c55406de313" released by "delete_volume" :: held 1.016s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Created reservations ['a2b31897-4b08-4a8a-902b-8ff441d2f0c7', '3c1a4ec6-77e2-44db-9ce5-b5d015f37965', '7ed195aa-7e4d-4746-8111-d5c77d76cef3', '38a73b98-5690-4b42-8211-21dd38c25e48'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:51 devstack sudo[88069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:51 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:51 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b15ad3de-2b89-45ff-8ddc-b705611faef0" returned: 0 in 0.454s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-quobyte-b15ad3de-2b89-45ff-8ddc-b705611faef0" released by "delete_volume" :: held 1.001s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Created reservations ['c8560e5c-ebc8-40b1-b3cc-1a244c87f7e7', '5a251198-5414-4b49-9d8f-0231954d7d57', '322b2308-d38a-48b3-be3c-702e0f28c98b', 'd6d12a68-4c47-4f0e-a7c9-3259ed2621f9'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:51 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:51 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:51 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.459s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Deleted volume successfully.
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b9385458-64ed-470e-8e85-e031f82890eb tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-596d95d5-9f25-41b4-89d8-9c55406de313-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:51 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.433s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Deleted volume successfully.
Apr 15 16:32:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96236b80-5209-47ff-b677-cc9bc3acdd3e tempest-CreateVolumesFromImageTest-1027758947 None] Lock "cinder-b15ad3de-2b89-45ff-8ddc-b705611faef0-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "cinder-7cda74f0-0fae-4a71-b1df-4976318be0af-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-7cda74f0-0fae-4a71-b1df-4976318be0af-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "cinder-quobyte-7cda74f0-0fae-4a71-b1df-4976318be0af" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-quobyte-7cda74f0-0fae-4a71-b1df-4976318be0af" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b23949-640e-4ae3-bf2a-5dc5f2d6141f]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:52 devstack sudo[88075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af
Apr 15 16:32:52 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:52 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af" returned: 0 in 0.481s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:52 devstack sudo[88080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af
Apr 15 16:32:52 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0df4bf-324e-4ab1-96e6-0cd230a73087]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:53 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce
Apr 15 16:32:53 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:53 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7cda74f0-0fae-4a71-b1df-4976318be0af" returned: 0 in 0.419s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-quobyte-7cda74f0-0fae-4a71-b1df-4976318be0af" released by "delete_volume" :: held 0.929s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Created reservations ['8e8f07a1-d116-492c-8b0a-77651e18f753', '1f82b8bf-b238-4075-b25b-a613fa277f4a', 'b2eb9d34-ab29-4d2d-896f-5c415e0ed035', 'e612437e-d9e3-4e7d-a0d2-f49da589dde4'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:53 devstack sudo[88085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:32:53 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:53 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce" returned: 0 in 0.557s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a9b0f4-a581-4d1a-8fde-aba5764bbc23]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:53 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce
Apr 15 16:32:53 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:53 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.509s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:32:53 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Deleted volume successfully.
Apr 15 16:32:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ee4bad2e-5373-4ec5-814f-fe6362f3f5ab tempest-VolumesListTestJSON-1196198714 None] Lock "cinder-7cda74f0-0fae-4a71-b1df-4976318be0af-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:32:54 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce" returned: 0 in 0.569s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.0bd1aa63-5b45-46be-a231-bcd50451019e0v6omane.img {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:54 devstack sudo[88096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.0bd1aa63-5b45-46be-a231-bcd50451019e0v6omane.img
Apr 15 16:32:54 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:56 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.0bd1aa63-5b45-46be-a231-bcd50451019e0v6omane.img" returned: 0 in 2.255s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[250d94e8-76b0-4e9e-bf71-0481c33b21c1]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:32:56 devstack sudo[88109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce
Apr 15 16:32:56 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Flow 'volume_create_manager' (7c5ba71e-91a6-4082-a5c7-27e6232540b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fee30fa-4f07-4c61-9214-7f19c9437bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fee30fa-4f07-4c61-9214-7f19c9437bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-761043529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9820582-98e7-40d7-bf35-c7cb34553653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1dead0f4e042d9a2d728593b312cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:56Z,use_quota=True,user_id='79ea2438b4a14e7a9679f3f9f0857f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd53228f-4fa7-4044-9358-2f12c86ac215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd53228f-4fa7-4044-9358-2f12c86ac215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512f2746-2c7e-4adb-a45a-9a89021e3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512f2746-2c7e-4adb-a45a-9a89021e3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9820582-98e7-40d7-bf35-c7cb34553653', 'volume_name': 'volume-b9820582-98e7-40d7-bf35-c7cb34553653', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe817c5-f48d-4876-b207-108e76f8a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe817c5-f48d-4876-b207-108e76f8a821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0f94a5-d564-45e8-95b0-35aa3cd2deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:32:56 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Volume b9820582-98e7-40d7-bf35-c7cb34553653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9820582-98e7-40d7-bf35-c7cb34553653', 'volume_size': 1}
Apr 15 16:32:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:32:57 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root
Apr 15 16:32:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce" returned: 0 in 0.665s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:32:57 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.0bd1aa63-5b45-46be-a231-bcd50451019e0v6omane.img {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:32:57 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Converted 1024.00 MB image at 453.79 MB/s
Apr 15 16:32:57 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] 0bd1aa63-5b45-46be-a231-bcd50451019e was raw, no need to convert to raw {{(pid=82156) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=171,cinder:INSERT=66,cinder:UPDATE=239,cinder:DELETE=20 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:UPDATE=230,cinder:DELETE=17,cinder:SELECT=181,cinder:INSERT=59 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.945s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Uploaded volume to glance image-id: 0bd1aa63-5b45-46be-a231-bcd50451019e. {{(pid=82156) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.365s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-761043529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9820582-98e7-40d7-bf35-c7cb34553653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1dead0f4e042d9a2d728593b312cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:32:56Z,use_quota=True,user_id='79ea2438b4a14e7a9679f3f9f0857f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Creating volume b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:33:07 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:33:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:07 devstack sudo[88117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653 1073741824
Apr 15 16:33:07 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:07 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-a2e17713-5241-4691-be23-37ba551172cf tempest-VolumesActionsTest-594480100 None] Copy volume to image completed successfully.
Apr 15 16:33:08 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653 1073741824" returned: 0 in 0.567s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:08 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653
Apr 15 16:33:08 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:09 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653" returned: 0 in 0.487s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.039s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0f94a5-d564-45e8-95b0-35aa3cd2deb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9820582-98e7-40d7-bf35-c7cb34553653', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2377dad-aa5b-4892-b737-759404ffeac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f939ff08-24e9-4bf7-bae7-df313d29f19d]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:09 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Volume volume-b9820582-98e7-40d7-bf35-c7cb34553653 (b9820582-98e7-40d7-bf35-c7cb34553653): created successfully
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2377dad-aa5b-4892-b737-759404ffeac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Flow 'volume_create_manager' (7c5ba71e-91a6-4082-a5c7-27e6232540b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:09 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-58daf2e7-3c75-40a0-9883-783c425fc495 tempest-VolumesSnapshotListTestJSON-2008677186 None] Created volume successfully.
Apr 15 16:33:09 devstack sudo[88125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce
Apr 15 16:33:09 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:09 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce" returned: 0 in 0.500s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2e0711-8d98-472a-a31c-8f62e072a062]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:09 devstack sudo[88130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce
Apr 15 16:33:09 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:10 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce" returned: 0 in 0.566s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:10 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img
Apr 15 16:33:10 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Flow 'volume_create_manager' (3482447f-9c8e-4d1f-9abd-2917b07a62af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a986ad0-608e-4bc6-8159-212e533abbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a986ad0-608e-4bc6-8159-212e533abbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1089881641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282c6fab-1172-46d6-83bc-1f1d4b27cb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12be2243378a45a29d27182875aedc2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:10Z,use_quota=True,user_id='b8b3b4864e2b4b8e8a6a29a6b2256261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1a999b-0455-47f3-a746-d2f7d3d41ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1a999b-0455-47f3-a746-d2f7d3d41ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4b617e-c271-4372-882c-9ca0c8c44b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4b617e-c271-4372-882c-9ca0c8c44b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282c6fab-1172-46d6-83bc-1f1d4b27cb3d', 'volume_name': 'volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dfeb68-dc76-4573-ab06-b74d1cd7353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dfeb68-dc76-4573-ab06-b74d1cd7353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4372b109-bb3f-4354-927c-aabd1d3c0b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:10 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Volume 282c6fab-1172-46d6-83bc-1f1d4b27cb3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d', 'volume_size': 1}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:12 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img" returned: 0 in 1.905s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:12 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[05195b2d-8a8d-4baf-8164-1ff17cb0a400]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:12 devstack sudo[88148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce
Apr 15 16:33:12 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:12 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce" returned: 0 in 0.594s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:12 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:33:12 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Converted 1024.00 MB image at 537.40 MB/s
Apr 15 16:33:12 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] 6609c482-2011-4fea-b03a-6d554f7420f8 was raw, converting to qcow2 {{(pid=82156) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 15 16:33:12 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b97f9a-ee58-4b48-9905-a4f82b79f2cf]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:12 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img
Apr 15 16:33:12 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:13 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:13 devstack sudo[88157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img
Apr 15 16:33:13 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:13 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img" returned: 1 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:33:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img /opt/stack/data/cinder/conversion/vol_upload_q846qhjw {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:13 devstack sudo[88162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img /opt/stack/data/cinder/conversion/vol_upload_q846qhjw
Apr 15 16:33:13 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:14 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img /opt/stack/data/cinder/conversion/vol_upload_q846qhjw" returned: 0 in 0.579s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:14 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Image conversion details: src /opt/stack/data/cinder/conversion/dd64687e-c0e8-4e93-9485-0f962c245bce.temp_image.6609c482-2011-4fea-b03a-6d554f7420f8ksbkqnon.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_q846qhjw {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:33:14 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 15 16:33:14 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cabc10-af76-4902-9a11-84e81251f6fc]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q846qhjw {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:14 devstack sudo[88167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q846qhjw
Apr 15 16:33:14 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:14 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q846qhjw" returned: 0 in 0.451s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.532s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Uploaded volume to glance image-id: 6609c482-2011-4fea-b03a-6d554f7420f8. {{(pid=82156) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.136s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1089881641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282c6fab-1172-46d6-83bc-1f1d4b27cb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12be2243378a45a29d27182875aedc2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:10Z,use_quota=True,user_id='b8b3b4864e2b4b8e8a6a29a6b2256261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Creating volume 282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:33:15 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:33:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:15 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d 1073741824
Apr 15 16:33:15 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-dc39d8a8-350f-4da8-866b-b7cf023d2847 tempest-VolumesActionsTest-594480100 None] Copy volume to image completed successfully.
Apr 15 16:33:16 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d 1073741824" returned: 0 in 0.473s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:16 devstack sudo[88177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d
Apr 15 16:33:16 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:16 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" returned: 0 in 0.419s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.061s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4372b109-bb3f-4354-927c-aabd1d3c0b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a769a82-7758-4dc9-9a4b-dab86d3d099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Creating offline snapshot 586c0549-37cb-4dd2-acea-9eadfe39b715 of volume b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:33:16 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Volume volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d (282c6fab-1172-46d6-83bc-1f1d4b27cb3d): created successfully
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a769a82-7758-4dc9-9a4b-dab86d3d099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Flow 'volume_create_manager' (3482447f-9c8e-4d1f-9abd-2917b07a62af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfc7386-0eaf-4b51-9c27-b65dee28ebfb]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:16 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2dfbf132-5995-4e15-92bf-1e0494d71329 tempest-SnapshotDependencyTests-719543581 None] Created volume successfully.
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Acquiring lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Acquiring lock "cinder-quobyte-dd64687e-c0e8-4e93-9485-0f962c245bce" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:16 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653
Apr 15 16:33:16 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Lock "cinder-quobyte-dd64687e-c0e8-4e93-9485-0f962c245bce" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f232c37-0d98-404f-ab47-b01827fe9a8f]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:16 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce
Apr 15 16:33:16 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:17 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653" returned: 0 in 0.547s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:17 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 1G
Apr 15 16:33:17 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:17 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce" returned: 0 in 0.514s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:17 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce
Apr 15 16:33:17 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:17 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:17 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 1G" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9820582-98e7-40d7-bf35-c7cb34553653 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-dd64687e-c0e8-4e93-9485-0f962c245bce" returned: 0 in 0.419s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Lock "cinder-quobyte-dd64687e-c0e8-4e93-9485-0f962c245bce" released by "delete_volume" :: held 0.959s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:17 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9820582-98e7-40d7-bf35-c7cb34553653 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715
Apr 15 16:33:17 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Created reservations ['e8d47cce-2a3a-41cc-9caa-229f4f3bb9df', 'cb6b3841-1ea0-4cee-8dec-7a3345cccada', '617b8bfc-b961-4eef-aeac-463c1b6697a0', 'b66428d3-157c-4c1e-a445-b0528fd5c826'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:17 devstack sudo[88201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:33:17 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:18 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9820582-98e7-40d7-bf35-c7cb34553653 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715" returned: 0 in 0.461s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:18 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 is being set with open permissions: ugo+rw
Apr 15 16:33:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:18 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715
Apr 15 16:33:18 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:18 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.425s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:18 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:33:18 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Deleted volume successfully.
Apr 15 16:33:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bebdbc71-b0e0-452a-9811-972171f82e34 tempest-VolumesActionsTest-594480100 None] Lock "cinder-dd64687e-c0e8-4e93-9485-0f962c245bce-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:18 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715" returned: 0 in 0.438s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:18 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.info
Apr 15 16:33:18 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:18 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.info" returned: 0 in 0.455s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:18 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.info is being set with open permissions: ugo+rw
Apr 15 16:33:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:18 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.info
Apr 15 16:33:18 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:19 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.info" returned: 0 in 0.431s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.895s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.494s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:19 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Creating offline snapshot 606d8e66-f48b-4006-81ea-ab0a7f91e89d of volume 282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:33:19 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-06820534-bbeb-4b38-a528-684998e5bf98 tempest-VolumesSnapshotListTestJSON-2008677186 None] Create snapshot completed successfully
Apr 15 16:33:19 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[406ac736-6151-46b6-af42-50bddc749a73]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:19 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d
Apr 15 16:33:19 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:20 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" returned: 0 in 0.570s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:20 devstack sudo[88224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d 1G
Apr 15 16:33:20 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:20 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d 1G" returned: 0 in 0.539s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:20 devstack sudo[88229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d
Apr 15 16:33:20 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:21 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d" returned: 0 in 0.471s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:21 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d is being set with open permissions: ugo+rw
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:21 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d
Apr 15 16:33:21 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:21 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d" returned: 0 in 0.461s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:21 devstack sudo[88237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.info
Apr 15 16:33:21 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Flow 'volume_create_manager' (f39c20a1-4d9a-4d72-9e24-8892b75f108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d023ec-570b-444f-8329-7c3fcfa24630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d023ec-570b-444f-8329-7c3fcfa24630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-692086791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6ff56a-250b-4049-9c52-b44c4f8e999c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f338abc4346546d196b713e2f8fe62b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:22Z,use_quota=True,user_id='527181332a58445a9b249924b74ed0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a405e5ae-c625-47dc-9ba6-9134087e4575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a405e5ae-c625-47dc-9ba6-9134087e4575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86a5f8b-af80-4423-8dcb-14ad8508e5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86a5f8b-af80-4423-8dcb-14ad8508e5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6ff56a-250b-4049-9c52-b44c4f8e999c', 'volume_name': 'volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a842c795-a8c6-49e9-8073-235e1af342b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a842c795-a8c6-49e9-8073-235e1af342b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dea555-74f1-41ab-be7f-e13bd11b0818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:21 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Volume 5e6ff56a-250b-4049-9c52-b44c4f8e999c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c', 'volume_size': 1}
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:21 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.info" returned: 0 in 0.452s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:21 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.info is being set with open permissions: ugo+rw
Apr 15 16:33:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:21 devstack sudo[88240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.info
Apr 15 16:33:21 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:22 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.info" returned: 0 in 0.403s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.997s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.705s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Creating offline snapshot 29fbb68b-1549-43d7-91ea-39e1a99984ff of volume b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:33:22 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e036025d-5378-4060-945f-e518979ca5c3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d4d056de-7eb3-4cdf-876d-b7d1daac7aa5 tempest-SnapshotDependencyTests-719543581 None] Create snapshot completed successfully
Apr 15 16:33:22 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715
Apr 15 16:33:22 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:22 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715" returned: 0 in 0.481s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9820582-98e7-40d7-bf35-c7cb34553653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:22 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff 1G
Apr 15 16:33:22 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Flow 'volume_create_manager' (53770724-bb62-4c1e-af3e-feb096e3cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d5a266-ff3c-4851-8140-5719214b1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d5a266-ff3c-4851-8140-5719214b1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266bf3d6-0ed2-43a3-88d9-eedb8a0aa225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12be2243378a45a29d27182875aedc2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=606d8e66-f48b-4006-81ea-ab0a7f91e89d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:23Z,use_quota=True,user_id='b8b3b4864e2b4b8e8a6a29a6b2256261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ad0151-e4a5-4b57-bf35-c7ea047cb594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ad0151-e4a5-4b57-bf35-c7ea047cb594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f69120-7e65-4b62-b249-9fe425cb6c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:23 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f69120-7e65-4b62-b249-9fe425cb6c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '266bf3d6-0ed2-43a3-88d9-eedb8a0aa225', 'volume_name': 'volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225', 'volume_size': 1, 'snapshot_id': '606d8e66-f48b-4006-81ea-ab0a7f91e89d'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b3d8d8-4619-462b-a192-1e3b0ee2470c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b3d8d8-4619-462b-a192-1e3b0ee2470c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ba8f13-3398-481c-a63f-32503256b1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:23 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Volume 266bf3d6-0ed2-43a3-88d9-eedb8a0aa225: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225', 'volume_size': 1, 'snapshot_id': '606d8e66-f48b-4006-81ea-ab0a7f91e89d'}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff 1G" returned: 0 in 0.562s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:23 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff
Apr 15 16:33:23 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:23 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff" returned: 0 in 0.429s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:23 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff is being set with open permissions: ugo+rw
Apr 15 16:33:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:23 devstack sudo[88258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff
Apr 15 16:33:23 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:24 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff" returned: 0 in 0.402s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.699s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-692086791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6ff56a-250b-4049-9c52-b44c4f8e999c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f338abc4346546d196b713e2f8fe62b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:22Z,use_quota=True,user_id='527181332a58445a9b249924b74ed0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Creating volume 5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:33:24 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:24 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b91a5f22-d4ab-49df-b062-f25b9e76dca4 tempest-VolumesSnapshotListTestJSON-2008677186 None] Create snapshot completed successfully
Apr 15 16:33:24 devstack sudo[88262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c 1073741824
Apr 15 16:33:24 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:24 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c 1073741824" returned: 0 in 0.498s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:24 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c
Apr 15 16:33:24 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:25 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c" returned: 0 in 0.419s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.808s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "cinder-quobyte-606d8e66-f48b-4006-81ea-ab0a7f91e89d-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" by "_create_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dea555-74f1-41ab-be7f-e13bd11b0818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ef53ef-e297-4a15-823f-037e56b64797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-606d8e66-f48b-4006-81ea-ab0a7f91e89d-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Creating volume 266bf3d6-0ed2-43a3-88d9-eedb8a0aa225 from snapshot 606d8e66-f48b-4006-81ea-ab0a7f91e89d {{(pid=82156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "cinder-quobyte-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:25 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Volume volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c (5e6ff56a-250b-4049-9c52-b44c4f8e999c): created successfully
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ef53ef-e297-4a15-823f-037e56b64797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Flow 'volume_create_manager' (f39c20a1-4d9a-4d72-9e24-8892b75f108b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:25 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e8424f40-06e2-4158-bb2c-b2cb74f61c96 tempest-VolumesCloneTest-1835032430 None] Created volume successfully.
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] snapshot: 606d8e66-f48b-4006-81ea-ab0a7f91e89d, volume: 266bf3d6-0ed2-43a3-88d9-eedb8a0aa225,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b88d37-9ed6-4ce4-8b98-7e787a241592]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:25 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d
Apr 15 16:33:25 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:25 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d" returned: 0 in 0.500s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1050c0b-e925-41ad-bdac-766f9092dbe0]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:25 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d
Apr 15 16:33:25 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:25 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Flow 'volume_create_manager' (2f5e0f67-3174-4ea1-93fe-39839cdce7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f44373f-1603-4ffa-9649-90d8cdbe2f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f44373f-1603-4ffa-9649-90d8cdbe2f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-411859729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d3d177-be9c-4e03-b56b-2d458384a58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f338abc4346546d196b713e2f8fe62b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=5e6ff56a-250b-4049-9c52-b44c4f8e999c,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:26Z,use_quota=True,user_id='527181332a58445a9b249924b74ed0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90d6f60-2e8a-42d5-898b-16f717741548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90d6f60-2e8a-42d5-898b-16f717741548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c480f5ed-8444-4a31-b98a-be5d2305667d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c480f5ed-8444-4a31-b98a-be5d2305667d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e4d3d177-be9c-4e03-b56b-2d458384a58d', 'volume_name': 'volume-e4d3d177-be9c-4e03-b56b-2d458384a58d', 'volume_size': 2, 'source_volid': '5e6ff56a-250b-4049-9c52-b44c4f8e999c', 'source_volstatus': 'available'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fde996e-ff83-4abd-b397-8d1c90988d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fde996e-ff83-4abd-b397-8d1c90988d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c10c20-a5ce-46d7-928e-a81be5ca6a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:26 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Volume e4d3d177-be9c-4e03-b56b-2d458384a58d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e4d3d177-be9c-4e03-b56b-2d458384a58d', 'volume_size': 2, 'source_volid': '5e6ff56a-250b-4049-9c52-b44c4f8e999c', 'source_volstatus': 'available'}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:26 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" returned: 0 in 0.501s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:33:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:26 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225
Apr 15 16:33:26 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:28 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" returned: 0 in 1.947s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:28 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b26759-76be-4dc7-8b07-c79a83941f43]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:28 devstack sudo[88293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d
Apr 15 16:33:28 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:28 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" returned: 0 in 0.585s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:28 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:33:28 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Converted 1024.00 MB image at 525.67 MB/s
Apr 15 16:33:28 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225 is being set with open permissions: ugo+rw
Apr 15 16:33:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:28 devstack sudo[88304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225
Apr 15 16:33:28 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:29 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" returned: 0 in 0.405s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" released by "_copy_volume_from_snapshot" :: held 3.992s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-606d8e66-f48b-4006-81ea-ab0a7f91e89d-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" released by "_create_volume_from_snapshot" :: held 4.027s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.048s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.391s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Creating offline snapshot 25049bbd-c15d-440e-8461-2e5d1402191d of volume b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[417c19bb-3362-4e0b-9829-3ecd6f3568cd]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ba8f13-3398-481c-a63f-32503256b1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225', 'volume_size': 1, 'snapshot_id': '606d8e66-f48b-4006-81ea-ab0a7f91e89d'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482bba6f-e712-4738-abfa-5a96ded1953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:29 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Volume volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225 (266bf3d6-0ed2-43a3-88d9-eedb8a0aa225): created successfully
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482bba6f-e712-4738-abfa-5a96ded1953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Flow 'volume_create_manager' (53770724-bb62-4c1e-af3e-feb096e3cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:29 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b7df6b38-08ad-44c6-8faa-87cc5b1d728a tempest-SnapshotDependencyTests-719543581 None] Created volume successfully.
Apr 15 16:33:29 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff
Apr 15 16:33:29 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "cinder-606d8e66-f48b-4006-81ea-ab0a7f91e89d-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-606d8e66-f48b-4006-81ea-ab0a7f91e89d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "cinder-quobyte-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "cinder-quobyte-606d8e66-f48b-4006-81ea-ab0a7f91e89d" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-606d8e66-f48b-4006-81ea-ab0a7f91e89d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Deleting offline snapshot 606d8e66-f48b-4006-81ea-ab0a7f91e89d of volume 282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] snapshot_file for this snap is: volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ef2fdc-db79-49f7-a3af-5cb8a25679ca]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:29 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff" returned: 0 in 0.488s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9820582-98e7-40d7-bf35-c7cb34553653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:29 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d
Apr 15 16:33:29 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:29 devstack sudo[88313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d 1G
Apr 15 16:33:29 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:30 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d" returned: 0 in 0.484s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a5edbb-289f-4d24-9760-162d702ea22e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:30 devstack sudo[88322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d
Apr 15 16:33:30 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:30 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d 1G" returned: 0 in 0.526s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:30 devstack sudo[88324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d
Apr 15 16:33:30 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:30 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" returned: 0 in 0.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:30 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d
Apr 15 16:33:30 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:30 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d" returned: 0 in 0.447s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:30 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d is being set with open permissions: ugo+rw
Apr 15 16:33:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:30 devstack sudo[88334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d
Apr 15 16:33:30 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:31 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d" returned: 0 in 0.440s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:31 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d
Apr 15 16:33:31 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:31 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d" returned: 0 in 0.438s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.237s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:31 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Cloning volume 5e6ff56a-250b-4049-9c52-b44c4f8e999c to volume e4d3d177-be9c-4e03-b56b-2d458384a58d
Apr 15 16:33:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8adb7c48-8a39-4c15-b2b4-6087869134a5 tempest-VolumesSnapshotListTestJSON-2008677186 None] Create snapshot completed successfully
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Creating offline snapshot 135159c5-8a79-4f8b-ace4-9d2545f2b4d6 of volume 5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[40007fc8-c27c-4776-ba6e-06c258a88599]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:31 devstack sudo[88342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c
Apr 15 16:33:31 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:31 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d.606d8e66-f48b-4006-81ea-ab0a7f91e89d" returned: 0 in 0.447s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-606d8e66-f48b-4006-81ea-ab0a7f91e89d" released by "_delete_snapshot" :: held 1.903s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" released by "delete_snapshot" :: held 1.917s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Created reservations ['c8de145d-b2fd-414c-9dd2-273f46f20414', '08ce9472-d0b6-43de-835f-b1d29fcf220d', 'ae7f2cf1-d1bc-4cdd-9433-e0c81e6f9e44', '96bd56d2-beca-47e6-89b4-3112bc7c07d0'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Delete snapshot completed successfully.
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1886c7fb-3eca-47ec-892d-a8b065857f80 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-606d8e66-f48b-4006-81ea-ab0a7f91e89d-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:31 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:31 devstack sudo[88348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 1G
Apr 15 16:33:31 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "cinder-282c6fab-1172-46d6-83bc-1f1d4b27cb3d-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-282c6fab-1172-46d6-83bc-1f1d4b27cb3d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "cinder-quobyte-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[65088b90-ca80-4305-89c7-dc9ccb237800]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:32 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d
Apr 15 16:33:32 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:32 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 1G" returned: 0 in 0.578s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:32 devstack sudo[88357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6
Apr 15 16:33:32 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:32 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" returned: 0 in 0.596s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:32 devstack sudo[88360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d
Apr 15 16:33:32 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-25049bbd-c15d-440e-8461-2e5d1402191d-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-25049bbd-c15d-440e-8461-2e5d1402191d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-quobyte-25049bbd-c15d-440e-8461-2e5d1402191d" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-25049bbd-c15d-440e-8461-2e5d1402191d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Deleting offline snapshot 25049bbd-c15d-440e-8461-2e5d1402191d of volume b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] snapshot_file for this snap is: volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0321fce7-dbbd-4c4f-8b12-a5d4a77be5f1]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:32 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6" returned: 0 in 0.540s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:32 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 is being set with open permissions: ugo+rw
Apr 15 16:33:32 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:32 devstack sudo[88365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d
Apr 15 16:33:32 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:32 devstack sudo[88367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6
Apr 15 16:33:32 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:33 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-282c6fab-1172-46d6-83bc-1f1d4b27cb3d" released by "delete_volume" :: held 1.095s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Created reservations ['a2b32d67-6d58-4b2b-9760-c5d9f91bc011', '7c9eb0c7-1570-401b-a892-6c965b8d4131', '762ddb3c-5c6e-4a88-b9b4-cc3bb497551d', '8afc63f7-3d91-4a99-8a82-e97ea7a38782'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:33 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:33:33 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:33 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d" returned: 0 in 0.495s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9820582-98e7-40d7-bf35-c7cb34553653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:33 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6" returned: 0 in 0.444s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4680199-52f7-4d40-a5aa-7046b367a8d1]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:33 devstack sudo[88377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.info
Apr 15 16:33:33 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:33 devstack sudo[88376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff
Apr 15 16:33:33 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:33 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.421s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:33:33 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Deleted volume successfully.
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-42e1726b-32f5-4a2e-8b60-1dbfb6e9b522 tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-282c6fab-1172-46d6-83bc-1f1d4b27cb3d-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:33 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.info" returned: 0 in 0.426s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:33 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.info is being set with open permissions: ugo+rw
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:33 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.info
Apr 15 16:33:33 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:33 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff" returned: 0 in 0.503s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9820582-98e7-40d7-bf35-c7cb34553653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:33 devstack sudo[88387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d
Apr 15 16:33:33 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "cinder-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "cinder-quobyte-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2aa006-86b0-47ed-90aa-dde1d8dc7b60]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:34 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225
Apr 15 16:33:34 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:34 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.info" returned: 0 in 0.408s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Acquiring lock "cinder-quobyte-e4d3d177-be9c-4e03-b56b-2d458384a58d" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Lock "cinder-quobyte-e4d3d177-be9c-4e03-b56b-2d458384a58d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] snapshot: 135159c5-8a79-4f8b-ace4-9d2545f2b4d6, volume: e4d3d177-be9c-4e03-b56b-2d458384a58d,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1729c31-b60b-4b4d-8ba5-de8fbf24bcbf]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:34 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6
Apr 15 16:33:34 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:34 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d" returned: 0 in 0.545s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:34 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d
Apr 15 16:33:34 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:34 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" returned: 0 in 0.521s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:34 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225
Apr 15 16:33:34 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:34 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6" returned: 0 in 0.528s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1a2847-8dbd-4f97-9f6a-e46c95addaf6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:34 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.25049bbd-c15d-440e-8461-2e5d1402191d" returned: 0 in 0.437s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:34 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c
Apr 15 16:33:34 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-25049bbd-c15d-440e-8461-2e5d1402191d" released by "_delete_snapshot" :: held 2.054s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" released by "delete_snapshot" :: held 2.066s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Created reservations ['d027d056-7b0a-4d15-bddb-50b05e7a29dc', '3e286932-151d-4072-89e5-8fe1617eaa07', 'e42335ec-2d79-4342-9642-be01cb9c084a', 'b84ee1f1-7abf-4e7a-bb8e-99bb20302917'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:34 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Delete snapshot completed successfully.
Apr 15 16:33:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e16ac4c5-ec88-4ee8-8260-90d2835edf9e tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-25049bbd-c15d-440e-8461-2e5d1402191d-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:35 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" returned: 0 in 0.458s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-quobyte-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225" released by "delete_volume" :: held 1.006s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Created reservations ['98559e6d-95a6-48ea-8b11-3d0d35822e82', '1a134882-66b3-4467-a647-6ba42b3097d4', 'a99c4c47-304b-405d-974b-c92ca04872a2', '0f2bb97f-4f84-4322-b311-75aa2d47d6a5'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:35 devstack sudo[88443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:33:35 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:35 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c" returned: 0 in 0.536s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:35 devstack sudo[88450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d
Apr 15 16:33:35 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:35 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.438s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:33:35 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Deleted volume successfully.
Apr 15 16:33:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae03f312-5082-4c50-abb9-1282795cfe5e tempest-SnapshotDependencyTests-719543581 None] Lock "cinder-266bf3d6-0ed2-43a3-88d9-eedb8a0aa225-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-29fbb68b-1549-43d7-91ea-39e1a99984ff-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-29fbb68b-1549-43d7-91ea-39e1a99984ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-quobyte-29fbb68b-1549-43d7-91ea-39e1a99984ff" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-29fbb68b-1549-43d7-91ea-39e1a99984ff" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Deleting offline snapshot 29fbb68b-1549-43d7-91ea-39e1a99984ff of volume b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] snapshot_file for this snap is: volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0138807a-e261-4e9f-9298-a474663857e2]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:36 devstack sudo[88463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff
Apr 15 16:33:36 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:36 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff" returned: 0 in 0.801s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9820582-98e7-40d7-bf35-c7cb34553653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e6cc6a-2d6c-49f5-b904-f1c2944f0f1b]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:37 devstack sudo[88468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715
Apr 15 16:33:37 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:37 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d" returned: 0 in 2.286s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:37 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df8958-9254-4d5d-af2a-194e2dfa5ded]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:37 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c
Apr 15 16:33:37 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:37 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715" returned: 0 in 0.882s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9820582-98e7-40d7-bf35-c7cb34553653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:37 devstack sudo[88476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff
Apr 15 16:33:37 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:38 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c" returned: 0 in 0.685s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:33:38 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Converted 1024.00 MB image at 447.45 MB/s
Apr 15 16:33:38 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d is being set with open permissions: ugo+rw
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:38 devstack sudo[88485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d
Apr 15 16:33:38 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:38 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff" returned: 0 in 0.541s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:38 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff
Apr 15 16:33:38 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:38 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d" returned: 0 in 0.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:38 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Lock "cinder-quobyte-e4d3d177-be9c-4e03-b56b-2d458384a58d" released by "_copy_volume_from_snapshot" :: held 4.562s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.29fbb68b-1549-43d7-91ea-39e1a99984ff" returned: 0 in 0.451s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-29fbb68b-1549-43d7-91ea-39e1a99984ff" released by "_delete_snapshot" :: held 2.772s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Acquiring lock "cinder-quobyte-135159c5-8a79-4f8b-ace4-9d2545f2b4d6" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" released by "delete_snapshot" :: held 2.797s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Lock "cinder-quobyte-135159c5-8a79-4f8b-ace4-9d2545f2b4d6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Deleting offline snapshot 135159c5-8a79-4f8b-ace4-9d2545f2b4d6 of volume 5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] snapshot_file for this snap is: volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c07251d-9840-4a0a-a508-599e181f04f9]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Created reservations ['21a494f0-71aa-4369-90be-40c53d981b17', '9a1fe344-3a7d-4c99-ad41-053c072ec5d9', '2bfc1e65-41ec-47ed-8b4c-87b9a838780a', '7ae94116-c980-4e49-ab0c-10e492dc557f'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:38 devstack sudo[88491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6
Apr 15 16:33:38 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:38 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Delete snapshot completed successfully.
Apr 15 16:33:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7bcc1a44-09b4-42f0-9b4b-857079c46da8 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-29fbb68b-1549-43d7-91ea-39e1a99984ff-delete_snapshot" released by "delete_snapshot" :: held 2.939s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-586c0549-37cb-4dd2-acea-9eadfe39b715-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-586c0549-37cb-4dd2-acea-9eadfe39b715-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-quobyte-586c0549-37cb-4dd2-acea-9eadfe39b715" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-586c0549-37cb-4dd2-acea-9eadfe39b715" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Deleting offline snapshot 586c0549-37cb-4dd2-acea-9eadfe39b715 of volume b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] snapshot_file for this snap is: volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaad945-7b00-4602-8722-b0d0f436f0a3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:39 devstack sudo[88493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715
Apr 15 16:33:39 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:39 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6" returned: 0 in 0.598s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[46992268-63e6-4ada-8868-39b655a75ca5]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:39 devstack sudo[88498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c
Apr 15 16:33:39 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:39 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715" returned: 0 in 0.537s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9820582-98e7-40d7-bf35-c7cb34553653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c89f40-9252-44b3-9eb2-79f916e650ee]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:39 devstack sudo[88503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653
Apr 15 16:33:39 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:40 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c" returned: 0 in 0.596s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:40 devstack sudo[88509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6
Apr 15 16:33:40 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:40 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653" returned: 0 in 0.539s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:40 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715
Apr 15 16:33:40 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:40 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6" returned: 0 in 0.507s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:40 devstack sudo[88519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6
Apr 15 16:33:40 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:41 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715" returned: 0 in 0.585s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:41 devstack sudo[88525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715
Apr 15 16:33:41 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:41 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c.135159c5-8a79-4f8b-ace4-9d2545f2b4d6" returned: 0 in 0.452s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Lock "cinder-quobyte-135159c5-8a79-4f8b-ace4-9d2545f2b4d6" released by "_delete_snapshot" :: held 2.203s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:41 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653.586c0549-37cb-4dd2-acea-9eadfe39b715" returned: 0 in 0.442s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-586c0549-37cb-4dd2-acea-9eadfe39b715" released by "_delete_snapshot" :: held 2.203s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" released by "delete_snapshot" :: held 2.217s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.671s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:42 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Created reservations ['cdc597cc-0357-4392-a7e5-95d33dafc3b7', 'ed972741-8e95-4fe4-8000-2399710da470', 'ae424503-aff8-4f8e-ade3-a59f3db1a593', 'ef11a772-5faf-4c43-a745-836abbbd174c'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c10c20-a5ce-46d7-928e-a81be5ca6a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d3d177-be9c-4e03-b56b-2d458384a58d', 'volume_size': 2, 'source_volid': '5e6ff56a-250b-4049-9c52-b44c4f8e999c', 'source_volstatus': 'available'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc28a6b-0875-4e5e-821f-3fc6db8ff7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:42 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Volume volume-e4d3d177-be9c-4e03-b56b-2d458384a58d (e4d3d177-be9c-4e03-b56b-2d458384a58d): created successfully
Apr 15 16:33:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc28a6b-0875-4e5e-821f-3fc6db8ff7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:42 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Flow 'volume_create_manager' (2f5e0f67-3174-4ea1-93fe-39839cdce7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Delete snapshot completed successfully.
Apr 15 16:33:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-459b612f-d9a2-420b-9265-bd30d5545b90 tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-586c0549-37cb-4dd2-acea-9eadfe39b715-delete_snapshot" released by "delete_snapshot" :: held 5.453s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:45 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9ccfa3af-39ca-45a5-9889-69fb211481ef tempest-VolumesCloneTest-1835032430 None] Created volume successfully.
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-b9820582-98e7-40d7-bf35-c7cb34553653-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Acquiring lock "cinder-e4d3d177-be9c-4e03-b56b-2d458384a58d-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-b9820582-98e7-40d7-bf35-c7cb34553653-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Lock "cinder-e4d3d177-be9c-4e03-b56b-2d458384a58d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Acquiring lock "cinder-quobyte-e4d3d177-be9c-4e03-b56b-2d458384a58d" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Lock "cinder-quobyte-e4d3d177-be9c-4e03-b56b-2d458384a58d" acquired by "delete_volume" :: waited 0.022s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" acquired by "delete_volume" :: waited 0.045s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[289c8884-7d45-48e0-bdfe-a5241de81a4c]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee81a884-d1c5-459d-9828-de6829e44144]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:47 devstack sudo[88529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d
Apr 15 16:33:47 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:47 devstack sudo[88530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653
Apr 15 16:33:47 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:47 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d" returned: 0 in 0.571s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:47 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653" returned: 0 in 0.574s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:47 devstack sudo[88540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d
Apr 15 16:33:47 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:47 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653
Apr 15 16:33:47 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:48 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b9820582-98e7-40d7-bf35-c7cb34553653" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-quobyte-b9820582-98e7-40d7-bf35-c7cb34553653" released by "delete_volume" :: held 1.082s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Created reservations ['1fef49b5-56d6-40f1-b503-e6a3741b711a', 'c0712719-fbd8-41ad-a0ee-b8801eaae383', '833190b4-e5aa-41ef-976e-3fdb99a6a32a', '3ef6c9fe-17c0-4064-81c9-0d0a5a0d59f9'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:48 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e4d3d177-be9c-4e03-b56b-2d458384a58d" returned: 0 in 0.557s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Lock "cinder-quobyte-e4d3d177-be9c-4e03-b56b-2d458384a58d" released by "delete_volume" :: held 1.215s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Created reservations ['086868cd-2507-453f-b7fc-19aef8307fb9', '0b676af5-ce93-443f-860b-3164b6de9274', 'a712669f-019d-414e-9cc3-54b28d68e055', 'f3a0565b-7543-4acc-afc0-c251a32b304d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:48 devstack sudo[88547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:33:48 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:48 devstack sudo[88551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:33:48 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:48 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.467s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:33:48 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Deleted volume successfully.
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-55fc79bd-a8a3-4b6a-ad08-c94c29ae47cd tempest-VolumesSnapshotListTestJSON-2008677186 None] Lock "cinder-b9820582-98e7-40d7-bf35-c7cb34553653-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:48 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.467s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:33:48 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Deleted volume successfully.
Apr 15 16:33:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e5417c76-6dcc-47f5-8fa4-6d409583a6a2 tempest-VolumesCloneTest-1835032430 None] Lock "cinder-e4d3d177-be9c-4e03-b56b-2d458384a58d-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Acquiring lock "cinder-5e6ff56a-250b-4049-9c52-b44c4f8e999c-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Lock "cinder-5e6ff56a-250b-4049-9c52-b44c4f8e999c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Acquiring lock "cinder-quobyte-5e6ff56a-250b-4049-9c52-b44c4f8e999c" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Lock "cinder-quobyte-5e6ff56a-250b-4049-9c52-b44c4f8e999c" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a26beae-175b-4a54-ad44-97e03c8b973a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:49 devstack sudo[88555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c
Apr 15 16:33:49 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:49 devstack sudo[88558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:33:49 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:49 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c" returned: 0 in 0.541s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:49 devstack sudo[88562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c
Apr 15 16:33:49 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:50 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.422s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:33:50 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5e6ff56a-250b-4049-9c52-b44c4f8e999c" returned: 0 in 0.438s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Lock "cinder-quobyte-5e6ff56a-250b-4049-9c52-b44c4f8e999c" released by "delete_volume" :: held 1.050s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Created reservations ['3f9ddf3f-00ad-4c43-a7ad-d94af65716de', '1bbabc9f-7d75-4343-a13a-00289b29fe2f', 'cc169e4b-9126-43b8-94ea-e8e1c4aceb38', '292f5bc7-20d6-44aa-a767-d56b0b994ea4'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:50 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:33:50 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:50 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:33:50 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Deleted volume successfully.
Apr 15 16:33:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24e7882-e854-44eb-9ed1-e4520f676975 tempest-VolumesCloneTest-1835032430 None] Lock "cinder-5e6ff56a-250b-4049-9c52-b44c4f8e999c-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Flow 'volume_create_manager' (21cb0e6c-676d-4957-8e6b-f37a3eaed044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669ebc7f-3fe5-41aa-8bc4-229192392725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669ebc7f-3fe5-41aa-8bc4-229192392725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-585631774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294f0069-d7c4-4929-973c-7ef892984192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109c99c87df647628bf2555f8436a3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:51Z,use_quota=True,user_id='04574f2044fa4b86bceda5f753d306e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d9d203-337b-4c2b-8736-9d2e75d21ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d9d203-337b-4c2b-8736-9d2e75d21ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f2f631-2b10-48bd-b074-6307074cfb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f2f631-2b10-48bd-b074-6307074cfb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294f0069-d7c4-4929-973c-7ef892984192', 'volume_name': 'volume-294f0069-d7c4-4929-973c-7ef892984192', 'volume_size': 2}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b36189-e472-410c-a78a-3780f04d3d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b36189-e472-410c-a78a-3780f04d3d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b9ee43-4111-43bd-9ccf-186c75a1e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:51 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Volume 294f0069-d7c4-4929-973c-7ef892984192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294f0069-d7c4-4929-973c-7ef892984192', 'volume_size': 2}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-585631774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294f0069-d7c4-4929-973c-7ef892984192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109c99c87df647628bf2555f8436a3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:51Z,use_quota=True,user_id='04574f2044fa4b86bceda5f753d306e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Creating volume 294f0069-d7c4-4929-973c-7ef892984192 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:33:51 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:33:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192 2147483648 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:51 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192 2147483648
Apr 15 16:33:51 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:52 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192 2147483648" returned: 0 in 0.588s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:52 devstack sudo[88574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192
Apr 15 16:33:52 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:52 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192" returned: 0 in 0.496s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:33:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b9ee43-4111-43bd-9ccf-186c75a1e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294f0069-d7c4-4929-973c-7ef892984192', 'volume_size': 2}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf60cca-f2a0-4f15-a0cc-1713c80d593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:52 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Volume volume-294f0069-d7c4-4929-973c-7ef892984192 (294f0069-d7c4-4929-973c-7ef892984192): created successfully
Apr 15 16:33:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf60cca-f2a0-4f15-a0cc-1713c80d593b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Flow 'volume_create_manager' (21cb0e6c-676d-4957-8e6b-f37a3eaed044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-990fb975-6f33-4d35-9ce6-06f00a014d9a tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Created volume successfully.
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (a5d5e45f-34ce-49fd-8407-bf5d5724eb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec4f118-1dbd-45a0-ba5b-d23fbd7b3668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec4f118-1dbd-45a0-ba5b-d23fbd7b3668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1539525754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8b88da-483b-47d0-9e11-47f7fcefc98b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:53Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b168d836-8b96-468c-bb97-bee5ba1fdf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b168d836-8b96-468c-bb97-bee5ba1fdf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c6bfaa-9627-497a-96dc-d3aae138621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c6bfaa-9627-497a-96dc-d3aae138621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8b88da-483b-47d0-9e11-47f7fcefc98b', 'volume_name': 'volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49c48d4-83a8-48cf-9581-2d6d4bef8f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49c48d4-83a8-48cf-9581-2d6d4bef8f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05ac725-5185-4e46-a17e-e570ddda091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:53 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Volume 5c8b88da-483b-47d0-9e11-47f7fcefc98b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b', 'volume_size': 1}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1539525754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8b88da-483b-47d0-9e11-47f7fcefc98b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:53Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Creating volume 5c8b88da-483b-47d0-9e11-47f7fcefc98b {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:33:53 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:53 devstack sudo[88577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b 1073741824
Apr 15 16:33:53 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:53 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b 1073741824" returned: 0 in 0.536s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:53 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b
Apr 15 16:33:53 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:54 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b" returned: 0 in 0.448s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.230s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05ac725-5185-4e46-a17e-e570ddda091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e9e2a6-146b-47ae-ba57-143967040160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Creating offline snapshot 9e60bc1c-b252-4427-8342-25a8f59a6383 of volume 294f0069-d7c4-4929-973c-7ef892984192 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40814eb-a869-4a82-88dd-73cbdd8a5d4a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:54 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Volume volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b (5c8b88da-483b-47d0-9e11-47f7fcefc98b): created successfully
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e9e2a6-146b-47ae-ba57-143967040160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (a5d5e45f-34ce-49fd-8407-bf5d5724eb87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:54 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-eb797efa-d94c-4e1f-bdf2-666888025063 tempest-VolumesGetTest-1704932694 None] Created volume successfully.
Apr 15 16:33:54 devstack sudo[88585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192
Apr 15 16:33:54 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:54 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192" returned: 0 in 0.475s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 2G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:54 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 2G
Apr 15 16:33:54 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:55 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 2G" returned: 0 in 0.481s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294f0069-d7c4-4929-973c-7ef892984192 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:55 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294f0069-d7c4-4929-973c-7ef892984192 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383
Apr 15 16:33:55 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:55 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294f0069-d7c4-4929-973c-7ef892984192 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383" returned: 0 in 0.476s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:55 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 is being set with open permissions: ugo+rw
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:55 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383
Apr 15 16:33:55 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (4a23e15c-d41a-42bd-bd81-faa365b82577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd48d30-12da-4675-86f4-c67ae54c34f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd48d30-12da-4675-86f4-c67ae54c34f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1497387722',display_name='tempest-VolumesGetTest-Volume-1948778486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46dc723f-f90c-4d35-b01c-60793f02325d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:56Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3ef1b6-07b0-4b0a-95d6-5f5e99de44d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3ef1b6-07b0-4b0a-95d6-5f5e99de44d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e6a65b-bece-4411-8f61-bbab590a8257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e6a65b-bece-4411-8f61-bbab590a8257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46dc723f-f90c-4d35-b01c-60793f02325d', 'volume_name': 'volume-46dc723f-f90c-4d35-b01c-60793f02325d', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829a2c4b-c9de-4faf-a8a7-a8b1188044bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829a2c4b-c9de-4faf-a8a7-a8b1188044bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc951e26-1cd0-45b2-aa70-44fd4f65f9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:55 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Volume 46dc723f-f90c-4d35-b01c-60793f02325d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46dc723f-f90c-4d35-b01c-60793f02325d', 'volume_size': 1}
Apr 15 16:33:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:56 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383" returned: 0 in 0.417s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:56 devstack sudo[88603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.info
Apr 15 16:33:56 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:56 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.info" returned: 0 in 0.428s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:56 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.info is being set with open permissions: ugo+rw
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:56 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.info
Apr 15 16:33:56 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:56 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.info" returned: 0 in 0.425s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.777s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.214s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:33:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1497387722',display_name='tempest-VolumesGetTest-Volume-1948778486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46dc723f-f90c-4d35-b01c-60793f02325d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:33:56Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Creating volume 46dc723f-f90c-4d35-b01c-60793f02325d {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:33:56 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:33:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:57 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d 1073741824
Apr 15 16:33:57 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:57 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d619a94d-e8f2-40b5-93e9-1583417ee603 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Create snapshot completed successfully
Apr 15 16:33:57 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d 1073741824" returned: 0 in 0.484s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:57 devstack sudo[88615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d
Apr 15 16:33:57 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:57 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d" returned: 0 in 0.406s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:33:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc951e26-1cd0-45b2-aa70-44fd4f65f9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46dc723f-f90c-4d35-b01c-60793f02325d', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376649cf-9858-4d81-a69b-c293542c1280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:33:57 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Volume volume-46dc723f-f90c-4d35-b01c-60793f02325d (46dc723f-f90c-4d35-b01c-60793f02325d): created successfully
Apr 15 16:33:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376649cf-9858-4d81-a69b-c293542c1280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:33:57 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (4a23e15c-d41a-42bd-bd81-faa365b82577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:33:57 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2677518c-324c-4265-9d61-998775550792 tempest-VolumesGetTest-1704932694 None] Created volume successfully.
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Acquiring lock "cinder-9e60bc1c-b252-4427-8342-25a8f59a6383-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-9e60bc1c-b252-4427-8342-25a8f59a6383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Acquiring lock "cinder-quobyte-294f0069-d7c4-4929-973c-7ef892984192" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-quobyte-294f0069-d7c4-4929-973c-7ef892984192" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Acquiring lock "cinder-quobyte-9e60bc1c-b252-4427-8342-25a8f59a6383" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-quobyte-9e60bc1c-b252-4427-8342-25a8f59a6383" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Deleting offline snapshot 9e60bc1c-b252-4427-8342-25a8f59a6383 of volume 294f0069-d7c4-4929-973c-7ef892984192 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] snapshot_file for this snap is: volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2f7bd-1256-4ff3-929b-27b9bcd6629d]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:58 devstack sudo[88618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383
Apr 15 16:33:58 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:58 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383" returned: 0 in 0.471s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-294f0069-d7c4-4929-973c-7ef892984192(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c1f6c3-dbb5-4aa4-975f-20a6c2ea1491]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:58 devstack sudo[88623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192
Apr 15 16:33:58 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-46dc723f-f90c-4d35-b01c-60793f02325d-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Lock "cinder-46dc723f-f90c-4d35-b01c-60793f02325d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-quobyte-46dc723f-f90c-4d35-b01c-60793f02325d" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-46dc723f-f90c-4d35-b01c-60793f02325d" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[21348f54-a353-4a88-8d0e-52063c65579c]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:59 devstack sudo[88625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d
Apr 15 16:33:59 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:59 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192" returned: 0 in 0.495s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:59 devstack sudo[88630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383
Apr 15 16:33:59 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:59 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d" returned: 0 in 0.487s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:59 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d
Apr 15 16:33:59 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:59 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383" returned: 0 in 0.455s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:33:59 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383
Apr 15 16:33:59 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:33:59 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-46dc723f-f90c-4d35-b01c-60793f02325d" returned: 0 in 0.403s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-46dc723f-f90c-4d35-b01c-60793f02325d" released by "delete_volume" :: held 0.914s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Created reservations ['e75b9f2a-8363-451a-b0fc-6121a13cfe90', '42abc7b0-3831-4175-82a2-54ac00bf3b7c', 'bcacbdc9-ba32-4d7c-9e14-7393ecbfb6b5', '29c0a25a-ab1f-42bb-9e29-fdf72976cecb'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:33:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:00 devstack sudo[88644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:00 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:00 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192.9e60bc1c-b252-4427-8342-25a8f59a6383" returned: 0 in 0.466s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-quobyte-9e60bc1c-b252-4427-8342-25a8f59a6383" released by "_delete_snapshot" :: held 1.943s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-quobyte-294f0069-d7c4-4929-973c-7ef892984192" released by "delete_snapshot" :: held 1.954s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-5c8b88da-483b-47d0-9e11-47f7fcefc98b-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Created reservations ['3c875a77-b6c1-4c8e-9737-ebfe511c6713', 'ae067fa9-8f3f-4c28-b7bb-bd89453a9699', '20e2fef7-84cc-4677-ab41-0d829bbc2fd2', 'c6f7261c-f38f-4f8b-ac19-8d05cc2ed2e3'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Lock "cinder-5c8b88da-483b-47d0-9e11-47f7fcefc98b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:00 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Delete snapshot completed successfully.
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fbea98c6-01cb-4aa7-89cd-aa5e50bc0980 tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-9e60bc1c-b252-4427-8342-25a8f59a6383-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-quobyte-5c8b88da-483b-47d0-9e11-47f7fcefc98b" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-5c8b88da-483b-47d0-9e11-47f7fcefc98b" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b954186e-28e6-44f7-86a5-3ebad3429918]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:00 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b
Apr 15 16:34:00 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Acquiring lock "cinder-294f0069-d7c4-4929-973c-7ef892984192-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-294f0069-d7c4-4929-973c-7ef892984192-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Acquiring lock "cinder-quobyte-294f0069-d7c4-4929-973c-7ef892984192" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-quobyte-294f0069-d7c4-4929-973c-7ef892984192" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[915d4ef8-f79a-4cd4-8a6a-2acdbbfba04e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:00 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:00 devstack sudo[88649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.466s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:00 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:00 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Deleted volume successfully.
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-33dd5b39-4423-422e-a0bb-65aa9ea891e0 tempest-VolumesGetTest-1704932694 None] Lock "cinder-46dc723f-f90c-4d35-b01c-60793f02325d-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:00 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b" returned: 0 in 0.524s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:00 devstack sudo[88654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b
Apr 15 16:34:00 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:00 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192" returned: 0 in 0.469s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:00 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192
Apr 15 16:34:00 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:01 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5c8b88da-483b-47d0-9e11-47f7fcefc98b" returned: 0 in 0.425s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-5c8b88da-483b-47d0-9e11-47f7fcefc98b" released by "delete_volume" :: held 0.975s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Created reservations ['50376a93-c3a7-427a-b862-368547a995a1', '4a2757dc-153d-4589-912c-1c0839006d2b', 'dd9073e2-4c5f-44cb-9ac6-5dbf0c695e52', '6a7091c8-1bb7-4f52-9f06-ca82cde7ec53'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:01 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-294f0069-d7c4-4929-973c-7ef892984192" returned: 0 in 0.441s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:01 devstack sudo[88663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:01 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-quobyte-294f0069-d7c4-4929-973c-7ef892984192" released by "delete_volume" :: held 0.953s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Created reservations ['f780ca2d-695e-4350-bf82-a91ccf0a53b8', 'd3c1fb67-2765-46d1-9dcb-cb8e02dc9d1d', 'e5ef4890-0683-4e55-b125-3a5469b5e291', '3dbbe054-d628-453c-8a12-50c7c5dd759c'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:01 devstack sudo[88665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:01 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:01 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.436s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:01 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Deleted volume successfully.
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9edda5e3-6ce9-4e2d-9a66-a9a8e7659529 tempest-VolumesGetTest-1704932694 None] Lock "cinder-5c8b88da-483b-47d0-9e11-47f7fcefc98b-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:01 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:01 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Deleted volume successfully.
Apr 15 16:34:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-96d9a068-63b8-4e0e-b851-14166b92738e tempest-VolumesSnapshotNegativeTestJSON-1313603821 None] Lock "cinder-294f0069-d7c4-4929-973c-7ef892984192-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (733e8a4b-36a7-4a6e-ac87-bf1b26e1bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a14127-4aa5-4630-a9b6-4c0ecbead7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a14127-4aa5-4630-a9b6-4c0ecbead7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1951361300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaac189c-df85-40b3-b75a-7aa8bfa8b000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:03Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62321ba0-b51e-4373-8f43-bf4f001e0918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62321ba0-b51e-4373-8f43-bf4f001e0918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2385e5d5-f3cb-4a0f-9afb-9eb1eecdfa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2385e5d5-f3cb-4a0f-9afb-9eb1eecdfa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaac189c-df85-40b3-b75a-7aa8bfa8b000', 'volume_name': 'volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c870296-c5ee-475f-8660-9a2a7acf6807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c870296-c5ee-475f-8660-9a2a7acf6807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a48171-82b9-48e4-b8ac-6bebf3246cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:02 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Volume eaac189c-df85-40b3-b75a-7aa8bfa8b000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000', 'volume_size': 1}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1951361300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaac189c-df85-40b3-b75a-7aa8bfa8b000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:03Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Creating volume eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:02 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:02 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 1073741824
Apr 15 16:34:02 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:03 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 1073741824" returned: 0 in 0.543s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (b434e65b-18b6-47ea-b84a-406dbaf4d856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256fb65d-ab90-41fb-996c-c84cede5a073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256fb65d-ab90-41fb-996c-c84cede5a073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-225426666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f44222-c340-41bd-870a-bb36b1f9f9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:03Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8942db-4c4b-4de1-8120-730cd6d946df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8942db-4c4b-4de1-8120-730cd6d946df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1982d5-6bd4-4aeb-801c-f59f5c0fedac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1982d5-6bd4-4aeb-801c-f59f5c0fedac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f44222-c340-41bd-870a-bb36b1f9f9a9', 'volume_name': 'volume-81f44222-c340-41bd-870a-bb36b1f9f9a9', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73f1e8f-e0f2-44e5-a45d-2f59e6379e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73f1e8f-e0f2-44e5-a45d-2f59e6379e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f94f1d6-082d-4858-ac7f-5d7863fc30e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:03 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume 81f44222-c340-41bd-870a-bb36b1f9f9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f44222-c340-41bd-870a-bb36b1f9f9a9', 'volume_size': 1}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:03 devstack sudo[88674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000
Apr 15 16:34:03 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:03 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000" returned: 0 in 0.413s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-225426666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f44222-c340-41bd-870a-bb36b1f9f9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:03Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Creating volume 81f44222-c340-41bd-870a-bb36b1f9f9a9 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:03 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a48171-82b9-48e4-b8ac-6bebf3246cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913fac30-df15-411a-9a76-e5d39e2e7c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:03 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9 1073741824
Apr 15 16:34:03 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:03 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Volume volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 (eaac189c-df85-40b3-b75a-7aa8bfa8b000): created successfully
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913fac30-df15-411a-9a76-e5d39e2e7c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (733e8a4b-36a7-4a6e-ac87-bf1b26e1bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:03 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-03cd43fb-2136-4258-b5b8-b0eb83bab1a4 tempest-VolumesGetTest-1704932694 None] Created volume successfully.
Apr 15 16:34:04 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9 1073741824" returned: 0 in 0.475s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:04 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9
Apr 15 16:34:04 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:04 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9" returned: 0 in 0.410s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f94f1d6-082d-4858-ac7f-5d7863fc30e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f44222-c340-41bd-870a-bb36b1f9f9a9', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2855d4c-d25f-4d03-97d7-43d67d70864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:04 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume volume-81f44222-c340-41bd-870a-bb36b1f9f9a9 (81f44222-c340-41bd-870a-bb36b1f9f9a9): created successfully
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2855d4c-d25f-4d03-97d7-43d67d70864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (b434e65b-18b6-47ea-b84a-406dbaf4d856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:04 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3302f652-8cb3-4a94-97d5-26cc616f76dd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created volume successfully.
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (f8dc2936-cd98-4b9d-b9d1-2d55b3ac4d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d308d3d-fad3-496f-b140-4bdd956ffe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d308d3d-fad3-496f-b140-4bdd956ffe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-777998680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4acc58-d79a-4576-8975-446fcb2fc9cb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=eaac189c-df85-40b3-b75a-7aa8bfa8b000,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:05Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e40f6e4-2736-4400-99fd-1d37d7674a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e40f6e4-2736-4400-99fd-1d37d7674a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32682514-2548-4995-8e79-f7d5fe3005ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32682514-2548-4995-8e79-f7d5fe3005ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ed4acc58-d79a-4576-8975-446fcb2fc9cb', 'volume_name': 'volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb', 'volume_size': 1, 'source_volid': 'eaac189c-df85-40b3-b75a-7aa8bfa8b000', 'source_volstatus': 'available'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9837b8-883a-4456-bda5-98b5be531ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9837b8-883a-4456-bda5-98b5be531ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7998a5-aa77-4c31-b62d-861232569a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:04 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Volume ed4acc58-d79a-4576-8975-446fcb2fc9cb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb', 'volume_size': 1, 'source_volid': 'eaac189c-df85-40b3-b75a-7aa8bfa8b000', 'source_volstatus': 'available'}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:04 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Cloning volume eaac189c-df85-40b3-b75a-7aa8bfa8b000 to volume ed4acc58-d79a-4576-8975-446fcb2fc9cb
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Creating offline snapshot 688a94e0-2064-4fd1-bfba-ce8c535de980 of volume eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e56cb9-eea7-4078-abb4-01e4eedffb90]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:05 devstack sudo[88685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000
Apr 15 16:34:05 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:05 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (d3a13b62-d37d-4b6b-9c78-53122a4ef92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b278b04-4ab2-4699-b2d1-29d8dca66014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b278b04-4ab2-4699-b2d1-29d8dca66014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99669441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331ac901-dade-46a6-b35c-d3d1fc810ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:05Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d54223-e6f9-4098-aa86-44a5116e25e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d54223-e6f9-4098-aa86-44a5116e25e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce06ae7-edaf-412e-9aea-b425a989c395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce06ae7-edaf-412e-9aea-b425a989c395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '331ac901-dade-46a6-b35c-d3d1fc810ad4', 'volume_name': 'volume-331ac901-dade-46a6-b35c-d3d1fc810ad4', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9fa842-7b8e-4321-9052-93c6e8e76c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9fa842-7b8e-4321-9052-93c6e8e76c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64036644-7b7e-42f1-9897-fe914213b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume 331ac901-dade-46a6-b35c-d3d1fc810ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-331ac901-dade-46a6-b35c-d3d1fc810ad4', 'volume_size': 1}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000" returned: 0 in 0.559s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:05 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 1G
Apr 15 16:34:05 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (9f8f1d05-6501-4b40-8c86-9e8bbebb4d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f54bf7-9d88-4712-a32c-892a25ba71ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f54bf7-9d88-4712-a32c-892a25ba71ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-189458424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2ff983-a237-4af0-b763-dc0c385abe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:06Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773ddb22-2f7b-41a0-9d49-01455ebef573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773ddb22-2f7b-41a0-9d49-01455ebef573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1be134c-ee9d-4bab-bb92-762ae47333e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1be134c-ee9d-4bab-bb92-762ae47333e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2ff983-a237-4af0-b763-dc0c385abe52', 'volume_name': 'volume-2d2ff983-a237-4af0-b763-dc0c385abe52', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7587ec1-60e5-4836-a61f-a4078ba71413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7587ec1-60e5-4836-a61f-a4078ba71413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd8ca53-c2f1-46b4-90c9-f52f50315a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume 2d2ff983-a237-4af0-b763-dc0c385abe52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2ff983-a237-4af0-b763-dc0c385abe52', 'volume_size': 1}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (047dfa45-0af2-48e6-ba72-7769e3410a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4284a2-471c-421c-9cf4-81c1e3f56a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4284a2-471c-421c-9cf4-81c1e3f56a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665781549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5700209d-3a18-46b1-884d-0b2b741bd41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:06Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061e3ec4-56d5-4a63-bca1-b4e8d9721026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061e3ec4-56d5-4a63-bca1-b4e8d9721026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42bfa6b-e5fa-417d-934b-9fa69ae038dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42bfa6b-e5fa-417d-934b-9fa69ae038dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5700209d-3a18-46b1-884d-0b2b741bd41f', 'volume_name': 'volume-5700209d-3a18-46b1-884d-0b2b741bd41f', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce36c87-3e8e-4633-9a2f-2fa328174c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce36c87-3e8e-4633-9a2f-2fa328174c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8387852-82f9-456e-9309-c75e56e936b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume 5700209d-3a18-46b1-884d-0b2b741bd41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5700209d-3a18-46b1-884d-0b2b741bd41f', 'volume_size': 1}
Apr 15 16:34:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (b564bdf0-a988-4765-b28e-74a0e329417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ce8183-0f34-47d1-9bd0-92204e32f6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ce8183-0f34-47d1-9bd0-92204e32f6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990678041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761a4b05-40b3-4546-a499-218ca1407c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:06Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fd5613-7746-49b2-b34f-145aa614ed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fd5613-7746-49b2-b34f-145aa614ed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58bcb71-0b03-424a-bcb1-1e48a3873057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58bcb71-0b03-424a-bcb1-1e48a3873057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761a4b05-40b3-4546-a499-218ca1407c22', 'volume_name': 'volume-761a4b05-40b3-4546-a499-218ca1407c22', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f75d2bd-f8d2-468c-b297-8b465fc26f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f75d2bd-f8d2-468c-b297-8b465fc26f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf1ebd8-a37f-460f-97f2-4f3ceff7eaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume 761a4b05-40b3-4546-a499-218ca1407c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761a4b05-40b3-4546-a499-218ca1407c22', 'volume_size': 1}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:06 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 1G" returned: 0 in 0.625s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:06 devstack sudo[88695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980
Apr 15 16:34:06 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (3696c55d-ab65-44b1-8351-8cd59477c54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1902d780-f208-4a66-ab5f-9b472294cf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1902d780-f208-4a66-ab5f-9b472294cf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043552047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87da83ee-21b6-40e7-91a0-f9ddca58d47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:06Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeedddad-55da-4aaf-8418-aac58ba8ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeedddad-55da-4aaf-8418-aac58ba8ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3beb598d-6994-4877-9f83-c755b0b8c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3beb598d-6994-4877-9f83-c755b0b8c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87da83ee-21b6-40e7-91a0-f9ddca58d47f', 'volume_name': 'volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6547203-cb4a-4306-8846-e8e6cacad454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6547203-cb4a-4306-8846-e8e6cacad454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5512c365-9a4b-4fad-ac91-6b2595c6b522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:06 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume 87da83ee-21b6-40e7-91a0-f9ddca58d47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f', 'volume_size': 1}
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:06 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980" returned: 0 in 0.463s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:06 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 is being set with open permissions: ugo+rw
Apr 15 16:34:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:06 devstack sudo[88701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980
Apr 15 16:34:06 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:07 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980" returned: 0 in 0.438s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:UPDATE=138,cinder:SELECT=116,cinder:DELETE=12,cinder:INSERT=33 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=124,cinder:UPDATE=144,cinder:INSERT=38,cinder:DELETE=12 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:07 devstack sudo[88704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.info
Apr 15 16:34:07 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:07 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.info" returned: 0 in 0.428s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:07 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.info is being set with open permissions: ugo+rw
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:07 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.info
Apr 15 16:34:07 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:07 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.info" returned: 0 in 0.396s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-quobyte-ed4acc58-d79a-4576-8975-446fcb2fc9cb" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-ed4acc58-d79a-4576-8975-446fcb2fc9cb" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] snapshot: 688a94e0-2064-4fd1-bfba-ce8c535de980, volume: ed4acc58-d79a-4576-8975-446fcb2fc9cb,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[af39b482-e5a7-4567-be38-145fe25b5ee5]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:08 devstack sudo[88711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980
Apr 15 16:34:08 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:08 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980" returned: 0 in 0.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:34:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:34:08 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:34:08 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6e14d-bc10-4588-85b5-4071f20e6f8e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:08 devstack sudo[88716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000
Apr 15 16:34:08 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:08 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000" returned: 0 in 0.480s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:08 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:34:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:08 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb
Apr 15 16:34:08 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:10 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb" returned: 0 in 1.995s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:10 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d2cdac-fa2f-4a8a-b583-3c6c5442ac2e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:11 devstack sudo[88733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000
Apr 15 16:34:11 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:11 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000" returned: 0 in 0.615s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:11 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:34:11 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Converted 1024.00 MB image at 512.98 MB/s
Apr 15 16:34:11 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb is being set with open permissions: ugo+rw
Apr 15 16:34:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:11 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb
Apr 15 16:34:11 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:11 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb" returned: 0 in 0.402s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-ed4acc58-d79a-4576-8975-446fcb2fc9cb" released by "_copy_volume_from_snapshot" :: held 4.012s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-quobyte-688a94e0-2064-4fd1-bfba-ce8c535de980" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-688a94e0-2064-4fd1-bfba-ce8c535de980" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Deleting offline snapshot 688a94e0-2064-4fd1-bfba-ce8c535de980 of volume eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:34:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] snapshot_file for this snap is: volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:34:12 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bb7250-6ce2-4b43-8679-8534a98c3b63]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:12 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980
Apr 15 16:34:12 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:12 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980" returned: 0 in 0.509s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:34:12 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b5901-426c-4939-829b-345cba3a35c4]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:12 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000
Apr 15 16:34:12 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:13 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000" returned: 0 in 0.494s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:13 devstack sudo[88751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980
Apr 15 16:34:13 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:13 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980" returned: 0 in 0.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:13 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980
Apr 15 16:34:13 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:13 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000.688a94e0-2064-4fd1-bfba-ce8c535de980" returned: 0 in 0.414s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-688a94e0-2064-4fd1-bfba-ce8c535de980" released by "_delete_snapshot" :: held 1.935s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.964s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.378s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99669441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331ac901-dade-46a6-b35c-d3d1fc810ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:05Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Creating volume 331ac901-dade-46a6-b35c-d3d1fc810ad4 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:13 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7998a5-aa77-4c31-b62d-861232569a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb', 'volume_size': 1, 'source_volid': 'eaac189c-df85-40b3-b75a-7aa8bfa8b000', 'source_volstatus': 'available'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:13 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4 1073741824
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd938fd-d906-4f22-83bb-6263343a05dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:13 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:13 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Volume volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb (ed4acc58-d79a-4576-8975-446fcb2fc9cb): created successfully
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd938fd-d906-4f22-83bb-6263343a05dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (f8dc2936-cd98-4b9d-b9d1-2d55b3ac4d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:14 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1173ebd9-43c9-485f-8edd-5a1eaf6b48bf tempest-VolumesGetTest-1704932694 None] Created volume successfully.
Apr 15 16:34:14 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4 1073741824" returned: 0 in 0.523s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:14 devstack sudo[88764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4
Apr 15 16:34:14 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (b71c9416-96db-4c48-98b1-e913f0b1df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b877586-57b9-48d8-88f9-e75cf2b398c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b877586-57b9-48d8-88f9-e75cf2b398c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-690280337',display_name='tempest-VolumesGetTest-Volume-1061526383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478ec555-e257-40d9-8026-6e99e26f9857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:15Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4639b83b-9db1-4da7-9959-23f8f30fd24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4639b83b-9db1-4da7-9959-23f8f30fd24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04edae75-cd69-4f05-9749-407a7587b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04edae75-cd69-4f05-9749-407a7587b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478ec555-e257-40d9-8026-6e99e26f9857', 'volume_name': 'volume-478ec555-e257-40d9-8026-6e99e26f9857', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad1101e-92ab-4924-b0db-d2a2e40a03bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad1101e-92ab-4924-b0db-d2a2e40a03bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e05b0e6-5e85-42b4-95d6-7fc4437b199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:14 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Volume 478ec555-e257-40d9-8026-6e99e26f9857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478ec555-e257-40d9-8026-6e99e26f9857', 'volume_size': 1}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:14 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.204s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-189458424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2ff983-a237-4af0-b763-dc0c385abe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:06Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Creating volume 2d2ff983-a237-4af0-b763-dc0c385abe52 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:14 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64036644-7b7e-42f1-9897-fe914213b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331ac901-dade-46a6-b35c-d3d1fc810ad4', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a834966c-1a38-470d-a291-53683b809755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:15 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52 1073741824
Apr 15 16:34:15 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:15 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume volume-331ac901-dade-46a6-b35c-d3d1fc810ad4 (331ac901-dade-46a6-b35c-d3d1fc810ad4): created successfully
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a834966c-1a38-470d-a291-53683b809755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (d3a13b62-d37d-4b6b-9c78-53122a4ef92f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-81da1237-6b43-4aec-a56a-4d4b48149dfc tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created volume successfully.
Apr 15 16:34:15 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52 1073741824" returned: 0 in 0.476s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:15 devstack sudo[88772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52
Apr 15 16:34:15 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:15 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52" returned: 0 in 0.428s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.995s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665781549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5700209d-3a18-46b1-884d-0b2b741bd41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:06Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Creating volume 5700209d-3a18-46b1-884d-0b2b741bd41f {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:15 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd8ca53-c2f1-46b4-90c9-f52f50315a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2ff983-a237-4af0-b763-dc0c385abe52', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08e20a8-57b0-430c-af09-2d14e8a3e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:15 devstack sudo[88775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f 1073741824
Apr 15 16:34:15 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:15 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume volume-2d2ff983-a237-4af0-b763-dc0c385abe52 (2d2ff983-a237-4af0-b763-dc0c385abe52): created successfully
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08e20a8-57b0-430c-af09-2d14e8a3e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (9f8f1d05-6501-4b40-8c86-9e8bbebb4d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-dbdbea46-48b1-41d2-8a35-882a89d6c945 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created volume successfully.
Apr 15 16:34:16 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f 1073741824" returned: 0 in 0.503s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:16 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f
Apr 15 16:34:16 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:16 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f" returned: 0 in 0.437s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.708s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990678041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761a4b05-40b3-4546-a499-218ca1407c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:06Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Creating volume 761a4b05-40b3-4546-a499-218ca1407c22 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:16 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8387852-82f9-456e-9309-c75e56e936b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5700209d-3a18-46b1-884d-0b2b741bd41f', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300a6844-daf2-418f-9073-e600105c91d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:16 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22 1073741824
Apr 15 16:34:16 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:16 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume volume-5700209d-3a18-46b1-884d-0b2b741bd41f (5700209d-3a18-46b1-884d-0b2b741bd41f): created successfully
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300a6844-daf2-418f-9073-e600105c91d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (047dfa45-0af2-48e6-ba72-7769e3410a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:16 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-258f9a31-c82f-4eed-a8ef-7c67c95340b4 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created volume successfully.
Apr 15 16:34:17 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22 1073741824" returned: 0 in 0.479s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:17 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22
Apr 15 16:34:17 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:17 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22" returned: 0 in 0.424s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.484s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043552047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87da83ee-21b6-40e7-91a0-f9ddca58d47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0712d7460b54918a12a4c81ebebeb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:06Z,use_quota=True,user_id='67e23f923277470fb2990e610b557a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Creating volume 87da83ee-21b6-40e7-91a0-f9ddca58d47f {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:17 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf1ebd8-a37f-460f-97f2-4f3ceff7eaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761a4b05-40b3-4546-a499-218ca1407c22', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:17 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f 1073741824
Apr 15 16:34:17 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7089e5-c244-4827-b604-6b242fcb7224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:17 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume volume-761a4b05-40b3-4546-a499-218ca1407c22 (761a4b05-40b3-4546-a499-218ca1407c22): created successfully
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7089e5-c244-4827-b604-6b242fcb7224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:17 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (b564bdf0-a988-4765-b28e-74a0e329417a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:17 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-996c8719-dcd1-4576-a1f9-752196ab8b8c tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created volume successfully.
Apr 15 16:34:18 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f 1073741824" returned: 0 in 0.502s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:18 devstack sudo[88797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f
Apr 15 16:34:18 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:18 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f" returned: 0 in 0.398s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.879s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-690280337',display_name='tempest-VolumesGetTest-Volume-1061526383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478ec555-e257-40d9-8026-6e99e26f9857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:15Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Creating volume 478ec555-e257-40d9-8026-6e99e26f9857 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:18 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5512c365-9a4b-4fad-ac91-6b2595c6b522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:18 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857 1073741824
Apr 15 16:34:18 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7795dd7a-d26f-4749-94d9-e6ac09ffad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:18 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Volume volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f (87da83ee-21b6-40e7-91a0-f9ddca58d47f): created successfully
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7795dd7a-d26f-4749-94d9-e6ac09ffad6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:18 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Flow 'volume_create_manager' (3696c55d-ab65-44b1-8351-8cd59477c54e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:18 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-aadeb840-be9d-42a1-892b-63e4debcb4cd tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created volume successfully.
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-87da83ee-21b6-40e7-91a0-f9ddca58d47f-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-87da83ee-21b6-40e7-91a0-f9ddca58d47f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-quobyte-87da83ee-21b6-40e7-91a0-f9ddca58d47f" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-87da83ee-21b6-40e7-91a0-f9ddca58d47f" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75b12db-f72f-4e95-81b9-29d56edf9339]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:19 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f
Apr 15 16:34:19 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:19 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857 1073741824" returned: 0 in 0.533s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:19 devstack sudo[88807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857
Apr 15 16:34:19 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:19 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f" returned: 0 in 0.485s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:19 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f
Apr 15 16:34:19 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:19 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857" returned: 0 in 0.412s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e05b0e6-5e85-42b4-95d6-7fc4437b199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478ec555-e257-40d9-8026-6e99e26f9857', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98d63c0-edff-43c5-8b0a-34de155c5307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:19 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Volume volume-478ec555-e257-40d9-8026-6e99e26f9857 (478ec555-e257-40d9-8026-6e99e26f9857): created successfully
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98d63c0-edff-43c5-8b0a-34de155c5307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:19 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (b71c9416-96db-4c48-98b1-e913f0b1df61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:19 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-941002ab-ff7b-49e2-8d13-122466b65ee0 tempest-VolumesGetTest-1704932694 None] Created volume successfully.
Apr 15 16:34:20 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-87da83ee-21b6-40e7-91a0-f9ddca58d47f" returned: 0 in 0.440s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-87da83ee-21b6-40e7-91a0-f9ddca58d47f" released by "delete_volume" :: held 0.956s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created reservations ['6b8948fa-eb53-40b5-ba93-13c8a0a93a70', '610bed76-a60e-4883-9e5e-0a50e1a88c2e', '580519a5-3c6a-4467-ab9c-2b83fab794f1', 'f7e451e8-6a49-42e0-b158-0c77e740dc96'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-478ec555-e257-40d9-8026-6e99e26f9857-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Lock "cinder-478ec555-e257-40d9-8026-6e99e26f9857-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-quobyte-478ec555-e257-40d9-8026-6e99e26f9857" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-478ec555-e257-40d9-8026-6e99e26f9857" acquired by "delete_volume" :: waited 0.029s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:20 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:20 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b717dc7-893f-4bce-9aa2-3531eef5529b]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-761a4b05-40b3-4546-a499-218ca1407c22-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-761a4b05-40b3-4546-a499-218ca1407c22-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-quobyte-761a4b05-40b3-4546-a499-218ca1407c22" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-761a4b05-40b3-4546-a499-218ca1407c22" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e123c1d2-4fb9-47d2-b3a6-8bd2c2cc7182]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:20 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857
Apr 15 16:34:20 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:20 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22
Apr 15 16:34:20 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:20 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.443s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:20 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Deleted volume successfully.
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-f9eed79a-0d63-45d6-91a9-f6330d0deb7d tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-87da83ee-21b6-40e7-91a0-f9ddca58d47f-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:20 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857" returned: 0 in 0.528s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:20 devstack sudo[88829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857
Apr 15 16:34:20 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:20 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22" returned: 0 in 0.519s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:20 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22
Apr 15 16:34:20 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:21 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-478ec555-e257-40d9-8026-6e99e26f9857" returned: 0 in 0.414s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-478ec555-e257-40d9-8026-6e99e26f9857" released by "delete_volume" :: held 0.968s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Created reservations ['053371f0-f3c3-4654-b4ee-5e7a39172bef', '1f418a95-d3f5-4500-bf85-6dc12707fc42', 'a2e2b832-ce3d-48e1-b4ae-a3a7ab67e460', '60b42317-e703-4460-8608-29d62cfffe81'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:21 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-761a4b05-40b3-4546-a499-218ca1407c22" returned: 0 in 0.437s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-761a4b05-40b3-4546-a499-218ca1407c22" released by "delete_volume" :: held 0.993s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:21 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:21 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created reservations ['07af46c2-6f5d-4bc3-a2c7-4d54c1c0027c', '1eedbece-c590-46e1-91fa-e8745fc189fa', '4b0bd460-bedf-4bcd-b36d-4d745858139c', 'aa443897-266e-4fee-bf63-ad4340e9d697'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:21 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:21 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:21 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.413s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:21 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Deleted volume successfully.
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c1d820f1-ecc3-488a-b33f-724df4613b91 tempest-VolumesGetTest-1704932694 None] Lock "cinder-478ec555-e257-40d9-8026-6e99e26f9857-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:21 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.409s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:21 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Deleted volume successfully.
Apr 15 16:34:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a9954d35-06b3-4c28-acdb-c22ed5c132b1 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-761a4b05-40b3-4546-a499-218ca1407c22-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-ed4acc58-d79a-4576-8975-446fcb2fc9cb-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Lock "cinder-ed4acc58-d79a-4576-8975-446fcb2fc9cb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-quobyte-ed4acc58-d79a-4576-8975-446fcb2fc9cb" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-5700209d-3a18-46b1-884d-0b2b741bd41f-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-5700209d-3a18-46b1-884d-0b2b741bd41f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-ed4acc58-d79a-4576-8975-446fcb2fc9cb" acquired by "delete_volume" :: waited 0.020s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[33391cfe-3bc5-4958-9ab9-2701df7c81e6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-quobyte-5700209d-3a18-46b1-884d-0b2b741bd41f" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-5700209d-3a18-46b1-884d-0b2b741bd41f" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[02436d39-7d6c-4e25-813b-bc69162f9cd1]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:22 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb
Apr 15 16:34:22 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:22 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f
Apr 15 16:34:22 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:22 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb" returned: 0 in 0.460s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:22 devstack sudo[88851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb
Apr 15 16:34:22 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:23 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:23 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f
Apr 15 16:34:23 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:23 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ed4acc58-d79a-4576-8975-446fcb2fc9cb" returned: 0 in 0.425s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-ed4acc58-d79a-4576-8975-446fcb2fc9cb" released by "delete_volume" :: held 0.911s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:23 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5700209d-3a18-46b1-884d-0b2b741bd41f" returned: 0 in 0.415s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-5700209d-3a18-46b1-884d-0b2b741bd41f" released by "delete_volume" :: held 0.899s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Created reservations ['d1d3dde3-59a5-4ec0-b097-3f940ad4abab', 'b1c870f7-d2ec-40d5-9b4e-42246597026c', '0955deb5-33a8-4e45-8152-dc6b4bb8752f', '0df7353e-063c-4db7-8b2b-55ef2c29ec6f'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created reservations ['20ae5bf0-f088-4522-b953-b4d3699ec2e8', 'fa2187e7-4807-4093-bc26-46f5095c4571', '1bfd5361-bf2d-419c-9ce3-343f7bd7570c', '4823bb0d-8226-4594-bc65-37bfa0215b41'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:23 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:23 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:23 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:23 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-eaac189c-df85-40b3-b75a-7aa8bfa8b000-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Lock "cinder-eaac189c-df85-40b3-b75a-7aa8bfa8b000-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-quobyte-eaac189c-df85-40b3-b75a-7aa8bfa8b000" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-eaac189c-df85-40b3-b75a-7aa8bfa8b000" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16de33a-a92e-4616-8d6d-6f0b4fa8bb53]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:23 devstack sudo[88861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000
Apr 15 16:34:23 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:23 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.443s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:23 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Deleted volume successfully.
Apr 15 16:34:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ccca6031-c4b3-4891-a487-06468609230c tempest-VolumesGetTest-1704932694 None] Lock "cinder-ed4acc58-d79a-4576-8975-446fcb2fc9cb-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:24 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.435s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:24 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Deleted volume successfully.
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7b2ec809-ed9c-4334-9a98-44fa42fe6b4a tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-5700209d-3a18-46b1-884d-0b2b741bd41f-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:24 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000" returned: 0 in 0.484s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:24 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000
Apr 15 16:34:24 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:24 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-eaac189c-df85-40b3-b75a-7aa8bfa8b000" returned: 0 in 0.410s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-eaac189c-df85-40b3-b75a-7aa8bfa8b000" released by "delete_volume" :: held 0.928s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Created reservations ['a6e55747-8cc6-4b7b-b765-ca6d885cb130', 'b5c3b580-0762-403b-bc1e-ccd6a8cb192f', '65b7cd06-f106-4471-8e0e-97bc9b47df80', 'd91d9441-712f-4e32-a22b-a43f7f5d193a'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-2d2ff983-a237-4af0-b763-dc0c385abe52-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-2d2ff983-a237-4af0-b763-dc0c385abe52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:24 devstack sudo[88872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:24 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-quobyte-2d2ff983-a237-4af0-b763-dc0c385abe52" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-2d2ff983-a237-4af0-b763-dc0c385abe52" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fffd9b-e398-45d7-adcf-a16aa68ec9d3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:24 devstack sudo[88874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52
Apr 15 16:34:24 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:25 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.471s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:25 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Deleted volume successfully.
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-85d5cdf3-f929-49bd-b767-f7ad46913b2d tempest-VolumesGetTest-1704932694 None] Lock "cinder-eaac189c-df85-40b3-b75a-7aa8bfa8b000-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (ae0fb5e9-eaab-4f9b-b1d3-823625d51aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec2eb35-3cc2-495e-a1e5-081f3635183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec2eb35-3cc2-495e-a1e5-081f3635183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-421470753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a3702d-bb94-4d7a-921d-90450bc3c9a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:25Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038de196-fa8c-4ee0-a98e-b6f566ca60b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038de196-fa8c-4ee0-a98e-b6f566ca60b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3000376f-21eb-4f97-b0f7-554d2f23f8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.image.glance [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Creating Keystone auth plugin from conf {{(pid=82156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 16:34:25 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52" returned: 0 in 0.571s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:25 devstack sudo[88880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52
Apr 15 16:34:25 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3000376f-21eb-4f97-b0f7-554d2f23f8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '64a3702d-bb94-4d7a-921d-90450bc3c9a9', 'volume_name': 'volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8df255330>}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405c6e0b-2bc5-4e15-9f39-89cae5b73c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405c6e0b-2bc5-4e15-9f39-89cae5b73c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdee6c8-d581-4123-9675-e690daec7522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:25 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Volume 64a3702d-bb94-4d7a-921d-90450bc3c9a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8df255330>}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Trying to clone 64a3702d-bb94-4d7a-921d-90450bc3c9a9 from image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]). {{(pid=82156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 16:34:25 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[10adf811-67e2-47f5-b7b6-53722c5c0a18]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:25 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2d2ff983-a237-4af0-b763-dc0c385abe52" returned: 0 in 0.410s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-2d2ff983-a237-4af0-b763-dc0c385abe52" released by "delete_volume" :: held 1.005s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:25 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD
Apr 15 16:34:25 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created reservations ['b33a2c8a-9e66-4680-9647-7e360d6eae0f', '106a813e-a017-4126-8686-053b4d02069a', 'f317f766-26c5-4378-b442-3012f676c4fe', '32f1a99d-6a1a-41cb-bbad-5c792368a218'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:25 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:25 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:26 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Temporary image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 is fetched for user 0f8636658f854a1d87af447c94fa9d36. {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80e7ae0-4ec1-41d4-a58d-eef26e5b8655]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:26 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.413s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:26 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Deleted volume successfully.
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-19c972db-aa5a-4623-b112-3e90c9d7a2df tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-2d2ff983-a237-4af0-b763-dc0c385abe52-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:26 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD
Apr 15 16:34:26 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:26 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-421470753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a3702d-bb94-4d7a-921d-90450bc3c9a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:25Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Creating volume 64a3702d-bb94-4d7a-921d-90450bc3c9a9 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:26 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:26 devstack sudo[88897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 1073741824
Apr 15 16:34:26 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-331ac901-dade-46a6-b35c-d3d1fc810ad4-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-331ac901-dade-46a6-b35c-d3d1fc810ad4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-quobyte-331ac901-dade-46a6-b35c-d3d1fc810ad4" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-331ac901-dade-46a6-b35c-d3d1fc810ad4" acquired by "delete_volume" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[165db9b6-0f17-4075-86f1-ff7166d2d23f]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:26 devstack sudo[88899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4
Apr 15 16:34:26 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:27 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 1073741824" returned: 0 in 0.496s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:27 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9
Apr 15 16:34:27 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:27 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4" returned: 0 in 0.490s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:27 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4
Apr 15 16:34:27 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:27 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9" returned: 0 in 0.422s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Attempting download of 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}])) to volume 64a3702d-bb94-4d7a-921d-90450bc3c9a9. {{(pid=82156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[def4b2fc-0032-4a3b-9114-12bf6ad8371b]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_53r2a209 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:27 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_53r2a209
Apr 15 16:34:27 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:27 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-331ac901-dade-46a6-b35c-d3d1fc810ad4" returned: 0 in 0.410s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-331ac901-dade-46a6-b35c-d3d1fc810ad4" released by "delete_volume" :: held 0.920s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created reservations ['dd206835-43bb-4c46-b820-e6e178c8810f', 'a84499e9-5d94-4449-a0ea-25ab428fd9c8', '3d535c1e-e09a-4cc2-bb19-e6ea43bfcb09', '635d5363-6a36-4369-9849-1b10505f77e1'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:27 devstack sudo[88916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:27 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-81f44222-c340-41bd-870a-bb36b1f9f9a9-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-81f44222-c340-41bd-870a-bb36b1f9f9a9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "cinder-quobyte-81f44222-c340-41bd-870a-bb36b1f9f9a9" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-81f44222-c340-41bd-870a-bb36b1f9f9a9" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[19124778-d07e-49d2-b2fa-8564a68f1b5c]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:28 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9
Apr 15 16:34:28 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:28 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_53r2a209" returned: 0 in 0.475s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_53r2a209 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:28 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_53r2a209
Apr 15 16:34:28 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:28 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.452s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:28 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Deleted volume successfully.
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7cc6a459-0611-4aee-b44f-82d92b56da01 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-331ac901-dade-46a6-b35c-d3d1fc810ad4-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:28 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9" returned: 0 in 0.475s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:28 devstack sudo[88928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9
Apr 15 16:34:28 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:28 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_53r2a209" returned: 1 in 0.466s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_53r2a209' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a8161-7def-48a0-907d-55a33ffda9fd]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:28 devstack sudo[88932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD
Apr 15 16:34:28 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:28 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81f44222-c340-41bd-870a-bb36b1f9f9a9" returned: 0 in 0.411s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-quobyte-81f44222-c340-41bd-870a-bb36b1f9f9a9" released by "delete_volume" :: held 0.910s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Created reservations ['b292610d-b9a4-493c-ade8-e6eade415183', '43603733-b2bd-4f12-92ba-14989eb24778', 'ec03ca74-d1ec-44b3-8e6f-8f702afb915e', '76c33283-6db5-4b0c-91b7-bb492647d290'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:29 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:29 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:29 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:29 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 was qcow2, converting to raw {{(pid=82156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 16:34:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:29 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9
Apr 15 16:34:29 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:29 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.501s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:29 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:29 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Deleted volume successfully.
Apr 15 16:34:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e80f142b-90d9-4d40-a928-aaa20f0d32e5 tempest-CreateVolumesFromSourceVolumeTest-1358610231 None] Lock "cinder-81f44222-c340-41bd-870a-bb36b1f9f9a9-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:30 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9" returned: 0 in 0.952s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:30 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47bfeefb-f50d-4a15-87d1-9373fdd09dd2_615tmg55devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:34:30 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Converted 112.00 MB image at 112.00 MB/s
Apr 15 16:34:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:30 devstack sudo[88964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 1G
Apr 15 16:34:30 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:30 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 1G" returned: 0 in 0.433s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:30 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e574731-043a-4d59-ac1e-8cf09e837c37]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:30 devstack sudo[88969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9
Apr 15 16:34:30 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:30 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9" returned: 0 in 0.448s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:30 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9
Apr 15 16:34:30 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:31 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9" returned: 1 in 0.476s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Downloaded image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}])) to volume 64a3702d-bb94-4d7a-921d-90450bc3c9a9 successfully. {{(pid=82156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Temporary image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 for user 0f8636658f854a1d87af447c94fa9d36 is deleted. {{(pid=82156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG cinder.volume.volume_utils [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Marking volume 64a3702d-bb94-4d7a-921d-90450bc3c9a9 as bootable. {{(pid=82156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Copying metadata from image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 to 64a3702d-bb94-4d7a-921d-90450bc3c9a9. {{(pid=82156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Creating volume glance metadata for volume 64a3702d-bb94-4d7a-921d-90450bc3c9a9 backed by image 47bfeefb-f50d-4a15-87d1-9373fdd09dd2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdee6c8-d581-4123-9675-e690daec7522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9', 'volume_size': 1, 'image_id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66d4b733bd9f404ca1ba6fb7e322e75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47bfeefb-f50d-4a15-87d1-9373fdd09dd2', 'created_at': datetime.datetime(2026, 4, 15, 14, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 14, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47bfeefb-f50d-4a15-87d1-9373fdd09dd2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe8df255330>}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67677946-f7a9-4704-a291-b9c3cf3e9106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:31 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Volume volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 (64a3702d-bb94-4d7a-921d-90450bc3c9a9): created successfully
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67677946-f7a9-4704-a291-b9c3cf3e9106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (ae0fb5e9-eaab-4f9b-b1d3-823625d51aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:31 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9173fbe0-1caf-41d8-8a64-05b7b0807d9f tempest-VolumesGetTest-1704932694 None] Created volume successfully.
Apr 15 16:34:32 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:32 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (54db9421-060a-4e5f-b2e3-cc993dd9c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:32 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea55961-bca2-408c-b66a-e934e681a0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:32 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea55961-bca2-408c-b66a-e934e681a0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1013279382',display_name='tempest-VolumesGetTest-Volume-512453194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36603354-0ce6-4277-8696-6c8ac3e07058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:33Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384dc02a-43a9-406b-8757-45531e423200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384dc02a-43a9-406b-8757-45531e423200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0202656-d305-4236-9c34-83a39361de79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0202656-d305-4236-9c34-83a39361de79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36603354-0ce6-4277-8696-6c8ac3e07058', 'volume_name': 'volume-36603354-0ce6-4277-8696-6c8ac3e07058', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed73718-1f55-43b6-8181-dfa673ad8a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed73718-1f55-43b6-8181-dfa673ad8a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be397dd3-96f3-4ff9-bd8c-107798a0d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:33 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Volume 36603354-0ce6-4277-8696-6c8ac3e07058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36603354-0ce6-4277-8696-6c8ac3e07058', 'volume_size': 1}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1013279382',display_name='tempest-VolumesGetTest-Volume-512453194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36603354-0ce6-4277-8696-6c8ac3e07058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61067d53622462a9a9557beeed244e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:33Z,use_quota=True,user_id='0f8636658f854a1d87af447c94fa9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Creating volume 36603354-0ce6-4277-8696-6c8ac3e07058 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:33 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:33 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058 1073741824
Apr 15 16:34:33 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:33 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058 1073741824" returned: 0 in 0.454s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:33 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058
Apr 15 16:34:33 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:33 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058" returned: 0 in 0.397s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be397dd3-96f3-4ff9-bd8c-107798a0d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36603354-0ce6-4277-8696-6c8ac3e07058', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac964313-1bad-4d43-ae12-3f02ed87a162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:33 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Volume volume-36603354-0ce6-4277-8696-6c8ac3e07058 (36603354-0ce6-4277-8696-6c8ac3e07058): created successfully
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac964313-1bad-4d43-ae12-3f02ed87a162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:33 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Flow 'volume_create_manager' (54db9421-060a-4e5f-b2e3-cc993dd9c329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:33 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8dd1b428-5403-413a-8bcf-175f744e477d tempest-VolumesGetTest-1704932694 None] Created volume successfully.
Apr 15 16:34:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-36603354-0ce6-4277-8696-6c8ac3e07058-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Lock "cinder-36603354-0ce6-4277-8696-6c8ac3e07058-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-quobyte-36603354-0ce6-4277-8696-6c8ac3e07058" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-36603354-0ce6-4277-8696-6c8ac3e07058" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:34 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f45df4e-f125-4b8d-a6f8-1d167b217709]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:34 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058
Apr 15 16:34:34 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:34 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058" returned: 0 in 0.454s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:34 devstack sudo[88991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058
Apr 15 16:34:34 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:35 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-36603354-0ce6-4277-8696-6c8ac3e07058" returned: 0 in 0.416s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-36603354-0ce6-4277-8696-6c8ac3e07058" released by "delete_volume" :: held 0.896s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Created reservations ['0917421c-25fb-4b69-a601-e2ac079505f1', 'b9b8bab9-b4bb-4d2b-9de2-6ef472165b8b', '0a2694f0-6aa6-4c0e-bfbf-9207572c0e76', 'b2155992-0e6d-4852-bebd-5808df697281'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:35 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:35 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-64a3702d-bb94-4d7a-921d-90450bc3c9a9-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Lock "cinder-64a3702d-bb94-4d7a-921d-90450bc3c9a9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Acquiring lock "cinder-quobyte-64a3702d-bb94-4d7a-921d-90450bc3c9a9" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-64a3702d-bb94-4d7a-921d-90450bc3c9a9" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c518175f-5f0e-4f57-906b-300f45ca2dc5]: (4, 'raw') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:35 devstack sudo[89008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9
Apr 15 16:34:35 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:35 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.457s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:35 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Deleted volume successfully.
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c24283b6-08fd-45c4-9701-560a2805cd41 tempest-VolumesGetTest-1704932694 None] Lock "cinder-36603354-0ce6-4277-8696-6c8ac3e07058-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:35 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9" returned: 0 in 0.460s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:35 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9
Apr 15 16:34:35 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:36 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9" returned: 1 in 0.450s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9' failed. Not Retrying. {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:36 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9
Apr 15 16:34:36 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:36 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-64a3702d-bb94-4d7a-921d-90450bc3c9a9" returned: 0 in 0.407s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Lock "cinder-quobyte-64a3702d-bb94-4d7a-921d-90450bc3c9a9" released by "delete_volume" :: held 1.372s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Created reservations ['d01f2278-4424-4c68-9453-8746adfabc11', '4516376c-7c8a-4dd3-b803-51a159c1a3df', 'a666e2e1-baa6-4336-a5d6-52dc8e777210', '402e2253-499e-443f-9144-6e6d1fc97bab'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:36 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:36 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:37 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.414s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:37 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Deleted volume successfully.
Apr 15 16:34:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbd751b6-df26-41f4-987c-5c6a71058e7a tempest-VolumesGetTest-1704932694 None] Lock "cinder-64a3702d-bb94-4d7a-921d-90450bc3c9a9-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (adb956cf-6005-48a8-b939-b9cee4cef664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d908aa28-2965-465e-a9aa-5285733dffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d908aa28-2965-465e-a9aa-5285733dffaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1420727514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ebd376-969e-4af3-8ef5-d3c330014536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0276c5f024610949edf0ed9f33f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:44Z,use_quota=True,user_id='91f8a74f8ba54a93a1b3ca9004c05865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1c7204-6d85-4862-93cc-f218ec434775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1c7204-6d85-4862-93cc-f218ec434775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5586dee-5d43-4bdb-b9b3-dd483334b3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5586dee-5d43-4bdb-b9b3-dd483334b3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ebd376-969e-4af3-8ef5-d3c330014536', 'volume_name': 'volume-09ebd376-969e-4af3-8ef5-d3c330014536', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6564e178-9fd5-4e3d-bba5-bbe6559c2f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6564e178-9fd5-4e3d-bba5-bbe6559c2f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d67d6d-26e9-4823-886b-add4dd8cd99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:44 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Volume 09ebd376-969e-4af3-8ef5-d3c330014536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ebd376-969e-4af3-8ef5-d3c330014536', 'volume_size': 1}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1420727514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ebd376-969e-4af3-8ef5-d3c330014536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0276c5f024610949edf0ed9f33f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:44Z,use_quota=True,user_id='91f8a74f8ba54a93a1b3ca9004c05865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Creating volume 09ebd376-969e-4af3-8ef5-d3c330014536 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:44 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:44 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536 1073741824
Apr 15 16:34:44 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:44 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536 1073741824" returned: 0 in 0.522s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:44 devstack sudo[89052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536
Apr 15 16:34:44 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:45 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536" returned: 0 in 0.407s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:45 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d67d6d-26e9-4823-886b-add4dd8cd99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ebd376-969e-4af3-8ef5-d3c330014536', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2294d5a6-3fb1-42ff-b4dd-16871945d228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:45 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Volume volume-09ebd376-969e-4af3-8ef5-d3c330014536 (09ebd376-969e-4af3-8ef5-d3c330014536): created successfully
Apr 15 16:34:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2294d5a6-3fb1-42ff-b4dd-16871945d228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:45 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (adb956cf-6005-48a8-b939-b9cee4cef664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:45 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e9a0122c-fde2-45e0-87af-5ca73a1ae6d5 tempest-VolumesSnapshotTestJSON-159252206 None] Created volume successfully.
Apr 15 16:34:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Creating offline snapshot 3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 of volume 09ebd376-969e-4af3-8ef5-d3c330014536 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:34:46 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d60c16-b872-41c3-ae4d-fc617b4596ad]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:46 devstack sudo[89055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536
Apr 15 16:34:46 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:46 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536" returned: 0 in 0.458s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:46 devstack sudo[89060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 1G
Apr 15 16:34:46 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:47 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 1G" returned: 0 in 0.466s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ebd376-969e-4af3-8ef5-d3c330014536 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:47 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ebd376-969e-4af3-8ef5-d3c330014536 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1
Apr 15 16:34:47 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:47 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ebd376-969e-4af3-8ef5-d3c330014536 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1" returned: 0 in 0.421s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:47 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 is being set with open permissions: ugo+rw
Apr 15 16:34:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:47 devstack sudo[89071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1
Apr 15 16:34:47 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:48 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1" returned: 0 in 0.407s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:48 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.info
Apr 15 16:34:48 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:48 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.info" returned: 0 in 0.410s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:48 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.info is being set with open permissions: ugo+rw
Apr 15 16:34:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:48 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.info
Apr 15 16:34:48 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:48 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.info" returned: 0 in 0.406s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:48 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9fce8722-909e-4947-ae9b-d6ee26cac584 tempest-VolumesSnapshotTestJSON-159252206 None] Create snapshot completed successfully
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-09ebd376-969e-4af3-8ef5-d3c330014536" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-09ebd376-969e-4af3-8ef5-d3c330014536" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Deleting offline snapshot 3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 of volume 09ebd376-969e-4af3-8ef5-d3c330014536 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] snapshot_file for this snap is: volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f835fd-a0c7-4ca4-a2dc-d87488d6887b]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:49 devstack sudo[89082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1
Apr 15 16:34:49 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:49 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:34:49 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:50 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1" returned: 0 in 0.503s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09ebd376-969e-4af3-8ef5-d3c330014536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:34:50 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5792405-7ad9-43d4-8a2d-fcc8210a5428]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:50 devstack sudo[89089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536
Apr 15 16:34:50 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:50 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.435s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:34:50 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536" returned: 0 in 0.470s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:50 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1
Apr 15 16:34:50 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:51 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1" returned: 0 in 0.433s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:51 devstack sudo[89100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1
Apr 15 16:34:51 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:51 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536.3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1" returned: 0 in 0.410s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1" released by "_delete_snapshot" :: held 1.874s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-09ebd376-969e-4af3-8ef5-d3c330014536" released by "delete_snapshot" :: held 1.887s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Created reservations ['07c06516-30d9-4e5a-862d-aebd9e06f841', '77932afe-230a-4f3b-9c86-204dc9f94f91', 'f4167c78-006d-4506-a03f-5f0b3865e9df', 'ab48440b-fbfc-4a70-b22b-bad72d556873'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:34:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Delete snapshot completed successfully.
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2d8fdda3-da25-4e8a-a8ea-2494849cbd0a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-3b79ba7c-d32a-424f-99a6-bbe3c4b3a4f1-delete_snapshot" released by "delete_snapshot" :: held 1.996s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (c5410b3a-ff40-4446-bacd-667902c08905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08d6ea7-766b-444b-afab-9fb22df6804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08d6ea7-766b-444b-afab-9fb22df6804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1519036258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e927985-baa7-4f2e-baf5-3c81fe460785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0276c5f024610949edf0ed9f33f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:52Z,use_quota=True,user_id='91f8a74f8ba54a93a1b3ca9004c05865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72018a2b-6c20-4771-8d76-f571d5cb0f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72018a2b-6c20-4771-8d76-f571d5cb0f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6627e0d6-2ffd-412e-b473-70273905934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6627e0d6-2ffd-412e-b473-70273905934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e927985-baa7-4f2e-baf5-3c81fe460785', 'volume_name': 'volume-7e927985-baa7-4f2e-baf5-3c81fe460785', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffc9257-8d80-4027-ab87-96d4aeba662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffc9257-8d80-4027-ab87-96d4aeba662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9111e4a2-0082-4527-bef4-3f44692d5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:51 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Volume 7e927985-baa7-4f2e-baf5-3c81fe460785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e927985-baa7-4f2e-baf5-3c81fe460785', 'volume_size': 1}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1519036258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e927985-baa7-4f2e-baf5-3c81fe460785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0276c5f024610949edf0ed9f33f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:52Z,use_quota=True,user_id='91f8a74f8ba54a93a1b3ca9004c05865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Creating volume 7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:51 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:34:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:52 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 1073741824
Apr 15 16:34:52 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:52 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 1073741824" returned: 0 in 0.467s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:52 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785
Apr 15 16:34:52 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:52 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785" returned: 0 in 0.398s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:34:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9111e4a2-0082-4527-bef4-3f44692d5f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e927985-baa7-4f2e-baf5-3c81fe460785', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9185c31c-b5a6-402b-a2f3-c7e1d0c5fce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:52 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Volume volume-7e927985-baa7-4f2e-baf5-3c81fe460785 (7e927985-baa7-4f2e-baf5-3c81fe460785): created successfully
Apr 15 16:34:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9185c31c-b5a6-402b-a2f3-c7e1d0c5fce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:52 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (c5410b3a-ff40-4446-bacd-667902c08905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b02e7f1a-c1c7-4858-bd88-c47ce6e34b61 tempest-VolumesSnapshotTestJSON-159252206 None] Created volume successfully.
Apr 15 16:34:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Creating offline snapshot 7c10c415-dd15-4544-9e55-a020f9109f3a of volume 7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:34:53 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6164c2-9df2-4970-84df-d3f45f47d1b8]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:53 devstack sudo[89111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785
Apr 15 16:34:53 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:53 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785" returned: 0 in 0.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:53 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a 1G
Apr 15 16:34:53 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:54 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a 1G" returned: 0 in 0.458s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e927985-baa7-4f2e-baf5-3c81fe460785 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:54 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e927985-baa7-4f2e-baf5-3c81fe460785 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a
Apr 15 16:34:54 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:54 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e927985-baa7-4f2e-baf5-3c81fe460785 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a" returned: 0 in 0.427s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:54 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a is being set with open permissions: ugo+rw
Apr 15 16:34:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:54 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a
Apr 15 16:34:54 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:54 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a" returned: 0 in 0.409s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:54 devstack sudo[89129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.info
Apr 15 16:34:54 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:55 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.info" returned: 0 in 0.421s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:55 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.info is being set with open permissions: ugo+rw
Apr 15 16:34:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:55 devstack sudo[89132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.info
Apr 15 16:34:55 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:55 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.info" returned: 0 in 0.404s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:55 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-bdd64d0e-9794-4b68-bb61-b6ff8976bd6a tempest-VolumesSnapshotTestJSON-159252206 None] Create snapshot completed successfully
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (15c8e69a-7e80-4aeb-9b64-faf9a0d418b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f136a7-cd2b-43bb-9c14-136271205541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f136a7-cd2b-43bb-9c14-136271205541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1361542552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a62d5a-dea7-438a-9a5b-918796b81a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0276c5f024610949edf0ed9f33f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:34:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7c10c415-dd15-4544-9e55-a020f9109f3a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:34:56Z,use_quota=True,user_id='91f8a74f8ba54a93a1b3ca9004c05865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898dc0a6-36ea-4474-a625-b63a7a186561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898dc0a6-36ea-4474-a625-b63a7a186561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a489292a-f751-4348-94b4-c782f8c27dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a489292a-f751-4348-94b4-c782f8c27dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6a62d5a-dea7-438a-9a5b-918796b81a58', 'volume_name': 'volume-f6a62d5a-dea7-438a-9a5b-918796b81a58', 'volume_size': 2, 'snapshot_id': '7c10c415-dd15-4544-9e55-a020f9109f3a'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d847e5-cf93-4582-abc1-5d5dda10559f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d847e5-cf93-4582-abc1-5d5dda10559f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e045c33-33a8-471d-976f-00d6caea7fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:34:56 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Volume f6a62d5a-dea7-438a-9a5b-918796b81a58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6a62d5a-dea7-438a-9a5b-918796b81a58', 'volume_size': 2, 'snapshot_id': '7c10c415-dd15-4544-9e55-a020f9109f3a'}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-7c10c415-dd15-4544-9e55-a020f9109f3a-f6a62d5a-dea7-438a-9a5b-918796b81a58" by "_create_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-7c10c415-dd15-4544-9e55-a020f9109f3a-f6a62d5a-dea7-438a-9a5b-918796b81a58" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Creating volume f6a62d5a-dea7-438a-9a5b-918796b81a58 from snapshot 7c10c415-dd15-4544-9e55-a020f9109f3a {{(pid=82156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-f6a62d5a-dea7-438a-9a5b-918796b81a58" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-f6a62d5a-dea7-438a-9a5b-918796b81a58" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] snapshot: 7c10c415-dd15-4544-9e55-a020f9109f3a, volume: f6a62d5a-dea7-438a-9a5b-918796b81a58,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1a8375-43eb-4e1b-86fc-082713e6e53a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:56 devstack sudo[89135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a
Apr 15 16:34:56 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:57 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a" returned: 0 in 0.464s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e927985-baa7-4f2e-baf5-3c81fe460785(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:34:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:34:57 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:34:57 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[37868d1e-97bf-4f17-b4a7-0274bfdcc66f]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:57 devstack sudo[89140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785
Apr 15 16:34:57 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:57 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:57 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:34:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:57 devstack sudo[89146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58
Apr 15 16:34:57 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:34:59 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root
Apr 15 16:34:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58" returned: 0 in 1.902s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:34:59 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e0c7ef-36ad-482a-99b7-67d98d6a4777]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:34:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:34:59 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785
Apr 15 16:34:59 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:00 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785" returned: 0 in 0.580s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785, size 1024.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:35:00 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Converted 1024.00 MB image at 537.92 MB/s
Apr 15 16:35:00 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58 is being set with open permissions: ugo+rw
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:00 devstack sudo[89163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58
Apr 15 16:35:00 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:00 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58" returned: 0 in 0.397s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-f6a62d5a-dea7-438a-9a5b-918796b81a58" released by "_copy_volume_from_snapshot" :: held 3.880s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-7c10c415-dd15-4544-9e55-a020f9109f3a-f6a62d5a-dea7-438a-9a5b-918796b81a58" released by "_create_volume_from_snapshot" :: held 3.896s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.904s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e045c33-33a8-471d-976f-00d6caea7fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a62d5a-dea7-438a-9a5b-918796b81a58', 'volume_size': 2, 'snapshot_id': '7c10c415-dd15-4544-9e55-a020f9109f3a'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2fafe1-8148-463f-a579-4044558b3684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:00 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Volume volume-f6a62d5a-dea7-438a-9a5b-918796b81a58 (f6a62d5a-dea7-438a-9a5b-918796b81a58): created successfully
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2fafe1-8148-463f-a579-4044558b3684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (15c8e69a-7e80-4aeb-9b64-faf9a0d418b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:00 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-aa5b312e-b4cb-4ffd-85b6-cb644d3139d8 tempest-VolumesSnapshotTestJSON-159252206 None] Created volume successfully.
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-f6a62d5a-dea7-438a-9a5b-918796b81a58-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-f6a62d5a-dea7-438a-9a5b-918796b81a58-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-f6a62d5a-dea7-438a-9a5b-918796b81a58" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-f6a62d5a-dea7-438a-9a5b-918796b81a58" acquired by "delete_volume" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af51367-3010-4334-b0e1-879302e684ef]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:00 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58
Apr 15 16:35:00 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:01 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58" returned: 0 in 0.460s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:01 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58
Apr 15 16:35:01 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:01 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f6a62d5a-dea7-438a-9a5b-918796b81a58" returned: 0 in 0.404s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-f6a62d5a-dea7-438a-9a5b-918796b81a58" released by "delete_volume" :: held 0.894s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Created reservations ['4a14e950-15dd-4aa5-a3e2-094ed5851ec2', '1a30ef19-6545-4a80-b410-b492b7796852', '8fdaccb8-6ca2-4fe3-9428-1432942ab0d7', '07124a6b-a2d1-4cb1-871a-119a89bf191d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:01 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:01 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-7c10c415-dd15-4544-9e55-a020f9109f3a-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-7c10c415-dd15-4544-9e55-a020f9109f3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-7e927985-baa7-4f2e-baf5-3c81fe460785" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-7e927985-baa7-4f2e-baf5-3c81fe460785" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-7c10c415-dd15-4544-9e55-a020f9109f3a" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-7c10c415-dd15-4544-9e55-a020f9109f3a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Deleting offline snapshot 7c10c415-dd15-4544-9e55-a020f9109f3a of volume 7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] snapshot_file for this snap is: volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888ddd6-a35b-4be2-b93c-21cf0018db22]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:02 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a
Apr 15 16:35:02 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:02 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.486s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:02 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:02 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Deleted volume successfully.
Apr 15 16:35:02 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8c532760-e797-4f62-9e3c-bc149524d847 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-f6a62d5a-dea7-438a-9a5b-918796b81a58-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:02 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a" returned: 0 in 0.547s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e927985-baa7-4f2e-baf5-3c81fe460785(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:35:02 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d68458-4a44-4e07-a401-32449c79ee20]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:02 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785
Apr 15 16:35:02 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:03 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785" returned: 0 in 0.501s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:03 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a
Apr 15 16:35:03 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:03 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a" returned: 0 in 0.443s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:03 devstack sudo[89192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a
Apr 15 16:35:03 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:03 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785.7c10c415-dd15-4544-9e55-a020f9109f3a" returned: 0 in 0.414s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:03 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-7c10c415-dd15-4544-9e55-a020f9109f3a" released by "_delete_snapshot" :: held 1.972s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:03 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-7e927985-baa7-4f2e-baf5-3c81fe460785" released by "delete_snapshot" :: held 1.985s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:03 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Created reservations ['555d3b69-f29f-489e-86d4-a5b6c9e5ed3c', '1a00f1d9-ad01-4018-9a7e-d5f07459c902', '2686e759-501a-4288-a0de-8e91849c1167', '422ab538-e8dc-4d47-824a-90abc26426bf'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:03 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Delete snapshot completed successfully.
Apr 15 16:35:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-af9b7d86-b0fa-4096-baac-38e83982a659 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-7c10c415-dd15-4544-9e55-a020f9109f3a-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-7e927985-baa7-4f2e-baf5-3c81fe460785-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-7e927985-baa7-4f2e-baf5-3c81fe460785-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-7e927985-baa7-4f2e-baf5-3c81fe460785" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:04 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-7e927985-baa7-4f2e-baf5-3c81fe460785" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:04 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aab89b3-f0bb-4971-89ef-7ca0d6ce90ec]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:04 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785
Apr 15 16:35:04 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:04 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785" returned: 0 in 0.456s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:04 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785
Apr 15 16:35:04 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:05 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7e927985-baa7-4f2e-baf5-3c81fe460785" returned: 0 in 0.422s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-7e927985-baa7-4f2e-baf5-3c81fe460785" released by "delete_volume" :: held 0.907s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Created reservations ['bbf23601-5773-4ed9-bdfb-dcde076edaa9', '45fa3080-92fc-4d8d-97ef-5fbccc009b35', '9efebe49-f3d6-4b08-ac1e-0cdb178cb36c', '9c6dee60-e89a-4476-9797-903cfa57fa4b'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:05 devstack sudo[89203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:05 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (a591960e-5dbe-498b-8c72-9941129f9307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dab2baa-10d0-443f-a2cd-033fdcffbae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dab2baa-10d0-443f-a2cd-033fdcffbae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1956210582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43dc7e33-3891-4225-85da-b018d2c37226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0276c5f024610949edf0ed9f33f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:05Z,use_quota=True,user_id='91f8a74f8ba54a93a1b3ca9004c05865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38ae9b2-b9a3-4954-9e73-3160a7187c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38ae9b2-b9a3-4954-9e73-3160a7187c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb049b5c-992a-426c-bc9a-4d9570fdd31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb049b5c-992a-426c-bc9a-4d9570fdd31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43dc7e33-3891-4225-85da-b018d2c37226', 'volume_name': 'volume-43dc7e33-3891-4225-85da-b018d2c37226', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:05 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d34909e-dc12-4cc2-a368-0da52c0d43ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d34909e-dc12-4cc2-a368-0da52c0d43ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7375ac60-3822-43d2-a1f6-1c898519bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Volume 43dc7e33-3891-4225-85da-b018d2c37226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43dc7e33-3891-4225-85da-b018d2c37226', 'volume_size': 1}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1956210582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43dc7e33-3891-4225-85da-b018d2c37226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0276c5f024610949edf0ed9f33f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:05Z,use_quota=True,user_id='91f8a74f8ba54a93a1b3ca9004c05865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Creating volume 43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:35:05 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.479s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:05 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Deleted volume successfully.
Apr 15 16:35:05 devstack sudo[89206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 1073741824
Apr 15 16:35:05 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:05 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8776b695-1c00-4249-8d0a-e9876eac54a8 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-7e927985-baa7-4f2e-baf5-3c81fe460785-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:06 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 1073741824" returned: 0 in 0.483s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:06 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226
Apr 15 16:35:06 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:06 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226" returned: 0 in 0.444s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:35:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7375ac60-3822-43d2-a1f6-1c898519bd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43dc7e33-3891-4225-85da-b018d2c37226', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafee5a2-9fe2-4655-a139-f2638d81fde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:06 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Volume volume-43dc7e33-3891-4225-85da-b018d2c37226 (43dc7e33-3891-4225-85da-b018d2c37226): created successfully
Apr 15 16:35:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafee5a2-9fe2-4655-a139-f2638d81fde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (a591960e-5dbe-498b-8c72-9941129f9307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:06 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-10d1bf8c-60f5-4899-8aba-bc75853f1444 tempest-VolumesSnapshotTestJSON-159252206 None] Created volume successfully.
Apr 15 16:35:07 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=134,cinder:INSERT=39,cinder:UPDATE=150,cinder:DELETE=12 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:35:07 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:UPDATE=163,cinder:SELECT=102,cinder:INSERT=49,cinder:DELETE=16 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:35:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Creating offline snapshot 3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 of volume 43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:35:07 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5991de22-f309-4135-b414-033b2cba09d3]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:07 devstack sudo[89216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226
Apr 15 16:35:07 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:08 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226" returned: 0 in 0.478s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:08 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 1G
Apr 15 16:35:08 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:08 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 1G" returned: 0 in 0.466s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43dc7e33-3891-4225-85da-b018d2c37226 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:08 devstack sudo[89226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43dc7e33-3891-4225-85da-b018d2c37226 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96
Apr 15 16:35:08 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:09 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43dc7e33-3891-4225-85da-b018d2c37226 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96" returned: 0 in 0.439s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:09 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 is being set with open permissions: ugo+rw
Apr 15 16:35:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:09 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96
Apr 15 16:35:09 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:09 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96" returned: 0 in 0.409s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:09 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.info
Apr 15 16:35:09 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:09 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.info" returned: 0 in 0.403s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:09 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.info is being set with open permissions: ugo+rw
Apr 15 16:35:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:09 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.info
Apr 15 16:35:09 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:10 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.info" returned: 0 in 0.404s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:10 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2f060a02-cc9f-4899-a8b6-c296599a402a tempest-VolumesSnapshotTestJSON-159252206 None] Create snapshot completed successfully
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (ddcb513e-8000-4a92-8863-8ce4918dc3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c717d796-59d4-4510-a6fd-e1b06417d8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c717d796-59d4-4510-a6fd-e1b06417d8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1197448940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47da5926-9eb0-4505-8b40-890a20955535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0276c5f024610949edf0ed9f33f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3cc24e52-8844-4b8f-9caa-0f84bdc4cd96,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:11Z,use_quota=True,user_id='91f8a74f8ba54a93a1b3ca9004c05865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69f20e9-babf-4681-8c7a-931bffdc6e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69f20e9-babf-4681-8c7a-931bffdc6e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e3a6b6-fbaa-41c3-ac8e-e3c9e85788ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e3a6b6-fbaa-41c3-ac8e-e3c9e85788ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47da5926-9eb0-4505-8b40-890a20955535', 'volume_name': 'volume-47da5926-9eb0-4505-8b40-890a20955535', 'volume_size': 1, 'snapshot_id': '3cc24e52-8844-4b8f-9caa-0f84bdc4cd96'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b577047-fa28-48f4-8ec2-11f791ce40e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b577047-fa28-48f4-8ec2-11f791ce40e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f557e8-6d7c-462d-87b0-c47e246742c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:11 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Volume 47da5926-9eb0-4505-8b40-890a20955535: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47da5926-9eb0-4505-8b40-890a20955535', 'volume_size': 1, 'snapshot_id': '3cc24e52-8844-4b8f-9caa-0f84bdc4cd96'}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-3cc24e52-8844-4b8f-9caa-0f84bdc4cd96-47da5926-9eb0-4505-8b40-890a20955535" by "_create_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-3cc24e52-8844-4b8f-9caa-0f84bdc4cd96-47da5926-9eb0-4505-8b40-890a20955535" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Creating volume 47da5926-9eb0-4505-8b40-890a20955535 from snapshot 3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 {{(pid=82156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-47da5926-9eb0-4505-8b40-890a20955535" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-47da5926-9eb0-4505-8b40-890a20955535" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] snapshot: 3cc24e52-8844-4b8f-9caa-0f84bdc4cd96, volume: 47da5926-9eb0-4505-8b40-890a20955535,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e06b68-813d-46b6-ae15-bfccb74c82c9]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:11 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96
Apr 15 16:35:11 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:11 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96" returned: 0 in 0.470s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43dc7e33-3891-4225-85da-b018d2c37226(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bed513-d7b4-4c4c-88a4-1efbda4c3034]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:11 devstack sudo[89245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226
Apr 15 16:35:11 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:12 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226" returned: 0 in 0.470s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:12 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:35:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:12 devstack sudo[89251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535
Apr 15 16:35:12 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:14 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535" returned: 0 in 1.910s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:14 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a989531-4f5a-4456-8e32-26cd41230379]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:14 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226
Apr 15 16:35:14 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:14 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226" returned: 0 in 0.605s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:14 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:35:14 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Converted 1024.00 MB image at 535.75 MB/s
Apr 15 16:35:14 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535 is being set with open permissions: ugo+rw
Apr 15 16:35:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:14 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535
Apr 15 16:35:14 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:15 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535" returned: 0 in 0.415s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-47da5926-9eb0-4505-8b40-890a20955535" released by "_copy_volume_from_snapshot" :: held 3.928s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-3cc24e52-8844-4b8f-9caa-0f84bdc4cd96-47da5926-9eb0-4505-8b40-890a20955535" released by "_create_volume_from_snapshot" :: held 3.944s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.955s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f557e8-6d7c-462d-87b0-c47e246742c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47da5926-9eb0-4505-8b40-890a20955535', 'volume_size': 1, 'snapshot_id': '3cc24e52-8844-4b8f-9caa-0f84bdc4cd96'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979da1d6-0a17-4384-884d-4f08876e9ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:15 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Volume volume-47da5926-9eb0-4505-8b40-890a20955535 (47da5926-9eb0-4505-8b40-890a20955535): created successfully
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979da1d6-0a17-4384-884d-4f08876e9ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Flow 'volume_create_manager' (ddcb513e-8000-4a92-8863-8ce4918dc3b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cb1c335e-6491-4fa3-ae4a-f7d8fcc04006 tempest-VolumesSnapshotTestJSON-159252206 None] Created volume successfully.
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-47da5926-9eb0-4505-8b40-890a20955535-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-47da5926-9eb0-4505-8b40-890a20955535-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-47da5926-9eb0-4505-8b40-890a20955535" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-47da5926-9eb0-4505-8b40-890a20955535" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce270cb-276e-44d8-9e0d-7bc0d08efef8]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:15 devstack sudo[89271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535
Apr 15 16:35:15 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:15 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535" returned: 0 in 0.464s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:15 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535
Apr 15 16:35:15 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:16 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-47da5926-9eb0-4505-8b40-890a20955535" returned: 0 in 0.403s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-47da5926-9eb0-4505-8b40-890a20955535" released by "delete_volume" :: held 0.892s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Created reservations ['c3cc192f-a892-4a6b-bea7-06fe48e2b676', '4bc9109c-c0b1-4e8d-94e5-6aabffc7de26', '66528be5-f360-42d9-b90b-f88c28453208', 'e4f780c3-2bd9-48e4-85d0-d4d11da0816d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:16 devstack sudo[89279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:16 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-3cc24e52-8844-4b8f-9caa-0f84bdc4cd96-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-3cc24e52-8844-4b8f-9caa-0f84bdc4cd96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-43dc7e33-3891-4225-85da-b018d2c37226" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-43dc7e33-3891-4225-85da-b018d2c37226" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-3cc24e52-8844-4b8f-9caa-0f84bdc4cd96" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-3cc24e52-8844-4b8f-9caa-0f84bdc4cd96" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Deleting offline snapshot 3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 of volume 43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] snapshot_file for this snap is: volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5391629-976d-41fc-9bcd-8ba9335e9059]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:16 devstack sudo[89281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96
Apr 15 16:35:16 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:16 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.427s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:16 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Deleted volume successfully.
Apr 15 16:35:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-18285b59-99a9-4926-a8a9-e4396420de2e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-47da5926-9eb0-4505-8b40-890a20955535-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:17 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96" returned: 0 in 0.458s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43dc7e33-3891-4225-85da-b018d2c37226(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:35:17 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6e437f-0b14-4b4c-8aa9-557185de7a94]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:17 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226
Apr 15 16:35:17 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:17 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:17 devstack sudo[89293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96
Apr 15 16:35:17 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:18 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96" returned: 0 in 0.437s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:18 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96
Apr 15 16:35:18 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:18 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226.3cc24e52-8844-4b8f-9caa-0f84bdc4cd96" returned: 0 in 0.406s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-3cc24e52-8844-4b8f-9caa-0f84bdc4cd96" released by "_delete_snapshot" :: held 1.819s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-43dc7e33-3891-4225-85da-b018d2c37226" released by "delete_snapshot" :: held 1.832s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Created reservations ['5bd542ab-8fb9-45b4-aa65-46419659c6cb', 'e5c7406b-4d5a-4d70-b7c3-586e7cce4d3f', 'd71fd9d1-ec30-415a-b909-42ae17f86751', 'b1e83d02-eff8-48e1-a4dc-411ed0239558'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:18 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Delete snapshot completed successfully.
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-75de476e-89e6-4f32-ae85-25c0d3b6283e tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-3cc24e52-8844-4b8f-9caa-0f84bdc4cd96-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-43dc7e33-3891-4225-85da-b018d2c37226-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-43dc7e33-3891-4225-85da-b018d2c37226-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-43dc7e33-3891-4225-85da-b018d2c37226" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-43dc7e33-3891-4225-85da-b018d2c37226" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[842e5a5e-37bc-44a2-b2a3-62d2f2e13686]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:18 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226
Apr 15 16:35:18 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:19 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226" returned: 0 in 0.483s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:19 devstack sudo[89306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226
Apr 15 16:35:19 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:19 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-43dc7e33-3891-4225-85da-b018d2c37226" returned: 0 in 0.405s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-43dc7e33-3891-4225-85da-b018d2c37226" released by "delete_volume" :: held 0.918s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Created reservations ['ce0dbb24-75e6-47b6-8d32-dedb998d0700', 'd5b11b82-9980-4e28-b1d0-9672175a7b51', '1c9c30d6-f602-4edc-bd19-a1f8f8e7915f', '157fbdc7-b2b3-40e6-91c4-baf8cdf8bc42'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:19 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:19 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-09ebd376-969e-4af3-8ef5-d3c330014536-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-09ebd376-969e-4af3-8ef5-d3c330014536-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "cinder-quobyte-09ebd376-969e-4af3-8ef5-d3c330014536" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-09ebd376-969e-4af3-8ef5-d3c330014536" acquired by "delete_volume" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4282820e-67ca-4674-b644-3b61bfc38c91]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:20 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536
Apr 15 16:35:20 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:20 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.440s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:20 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Deleted volume successfully.
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-04fee867-a61a-4b0f-b713-2c8823ab5a1c tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-43dc7e33-3891-4225-85da-b018d2c37226-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:20 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536" returned: 0 in 0.472s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:20 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536
Apr 15 16:35:20 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:20 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-09ebd376-969e-4af3-8ef5-d3c330014536" returned: 0 in 0.416s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-quobyte-09ebd376-969e-4af3-8ef5-d3c330014536" released by "delete_volume" :: held 0.913s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Created reservations ['857495e1-b978-406e-8c84-8c3c40d3bc94', '2369b6d6-3a71-4a9f-8f34-0c67fec9803d', '5f0266c4-b9e8-41ad-9889-11cb6be5d298', '15e75424-6bde-42e9-b697-c92ea2435712'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:20 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:20 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:21 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.415s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:21 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:21 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Deleted volume successfully.
Apr 15 16:35:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c4b70563-afc0-40e0-9b97-79c1aa47d46d tempest-VolumesSnapshotTestJSON-159252206 None] Lock "cinder-09ebd376-969e-4af3-8ef5-d3c330014536-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Flow 'volume_create_manager' (7d34f5a5-37a0-4bf9-a8f3-3a7d6b6ff244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3381a17b-dfaa-4c9a-8162-66e1d9edd630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3381a17b-dfaa-4c9a-8162-66e1d9edd630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1684731983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42217103-6c3e-4356-b2ab-e264e13d706c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72f7407378c46d2a69f41c11ad49775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:25Z,use_quota=True,user_id='2adbc99fc99a44fabb54d2fe1ebeba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b5557f-da9e-4c8f-bc11-e4743916578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b5557f-da9e-4c8f-bc11-e4743916578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab3b98e-8896-4cf1-971b-f2c6576f66b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab3b98e-8896-4cf1-971b-f2c6576f66b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42217103-6c3e-4356-b2ab-e264e13d706c', 'volume_name': 'volume-42217103-6c3e-4356-b2ab-e264e13d706c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4e72e7-afc2-4be6-8f2a-55a73d01d8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4e72e7-afc2-4be6-8f2a-55a73d01d8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da64ef5-e8d4-4a48-bc6e-f12e86482e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:24 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Volume 42217103-6c3e-4356-b2ab-e264e13d706c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42217103-6c3e-4356-b2ab-e264e13d706c', 'volume_size': 1}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1684731983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42217103-6c3e-4356-b2ab-e264e13d706c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72f7407378c46d2a69f41c11ad49775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:25Z,use_quota=True,user_id='2adbc99fc99a44fabb54d2fe1ebeba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Creating volume 42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:35:24 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:35:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:24 devstack sudo[89326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c 1073741824
Apr 15 16:35:24 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:25 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c 1073741824" returned: 0 in 0.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:25 devstack sudo[89331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c
Apr 15 16:35:25 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:25 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c" returned: 0 in 0.402s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:35:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da64ef5-e8d4-4a48-bc6e-f12e86482e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42217103-6c3e-4356-b2ab-e264e13d706c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f384ea6-1153-49ae-b13d-fadf46f43d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:25 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Volume volume-42217103-6c3e-4356-b2ab-e264e13d706c (42217103-6c3e-4356-b2ab-e264e13d706c): created successfully
Apr 15 16:35:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f384ea6-1153-49ae-b13d-fadf46f43d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:25 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Flow 'volume_create_manager' (7d34f5a5-37a0-4bf9-a8f3-3a7d6b6ff244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:25 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2f4475cd-b508-4864-a750-32635d4e026a tempest-VolumeDependencyTests-270366997 None] Created volume successfully.
Apr 15 16:35:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Creating offline snapshot 174962b1-ea9a-42c2-a1f8-4a53c871fd6c of volume 42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:35:26 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d5af65-0f31-4687-8f4f-638dc1c58d31]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:26 devstack sudo[89334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c
Apr 15 16:35:26 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:27 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c" returned: 0 in 0.463s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:27 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c 1G
Apr 15 16:35:27 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:27 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c 1G" returned: 0 in 0.456s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42217103-6c3e-4356-b2ab-e264e13d706c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:27 devstack sudo[89345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42217103-6c3e-4356-b2ab-e264e13d706c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c
Apr 15 16:35:27 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:28 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42217103-6c3e-4356-b2ab-e264e13d706c -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c" returned: 0 in 0.417s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:28 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c is being set with open permissions: ugo+rw
Apr 15 16:35:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:28 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c
Apr 15 16:35:28 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:28 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c" returned: 0 in 0.395s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:28 devstack sudo[89353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.info
Apr 15 16:35:28 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:28 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.info" returned: 0 in 0.408s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:28 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.info is being set with open permissions: ugo+rw
Apr 15 16:35:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:28 devstack sudo[89362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.info
Apr 15 16:35:28 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:29 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.info" returned: 0 in 0.401s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.594s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:29 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-fef1a8cb-f347-45cb-a837-5767668d851e tempest-VolumeDependencyTests-270366997 None] Create snapshot completed successfully
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Flow 'volume_create_manager' (8e38eb46-fa78-4ae0-a898-1ce158842ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16100c21-c29d-4ff8-a769-e9ed4f0240cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16100c21-c29d-4ff8-a769-e9ed4f0240cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1872178354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdaa6fe-0829-4d6a-9674-eb8b112d6f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72f7407378c46d2a69f41c11ad49775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=174962b1-ea9a-42c2-a1f8-4a53c871fd6c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:30Z,use_quota=True,user_id='2adbc99fc99a44fabb54d2fe1ebeba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85777559-83de-4d8e-b0b5-03ab72dc0156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85777559-83de-4d8e-b0b5-03ab72dc0156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733f1fd7-59ba-4f67-8108-dcf6dedde9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733f1fd7-59ba-4f67-8108-dcf6dedde9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ccdaa6fe-0829-4d6a-9674-eb8b112d6f98', 'volume_name': 'volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98', 'volume_size': 1, 'snapshot_id': '174962b1-ea9a-42c2-a1f8-4a53c871fd6c'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177f022f-6206-46fc-a2c5-19515c635d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177f022f-6206-46fc-a2c5-19515c635d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c400967-2976-44aa-9dee-2b674ed3d61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Volume ccdaa6fe-0829-4d6a-9674-eb8b112d6f98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98', 'volume_size': 1, 'snapshot_id': '174962b1-ea9a-42c2-a1f8-4a53c871fd6c'}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-174962b1-ea9a-42c2-a1f8-4a53c871fd6c-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" by "_create_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-174962b1-ea9a-42c2-a1f8-4a53c871fd6c-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Creating volume ccdaa6fe-0829-4d6a-9674-eb8b112d6f98 from snapshot 174962b1-ea9a-42c2-a1f8-4a53c871fd6c {{(pid=82156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] snapshot: 174962b1-ea9a-42c2-a1f8-4a53c871fd6c, volume: ccdaa6fe-0829-4d6a-9674-eb8b112d6f98,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bbf566-3a5c-4eb7-a3a3-8411a88a62e9]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:30 devstack sudo[89365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c
Apr 15 16:35:30 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:30 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c" returned: 0 in 0.454s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42217103-6c3e-4356-b2ab-e264e13d706c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3f9a1f-5609-4c5a-875d-973d19779294]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:30 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c
Apr 15 16:35:30 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:31 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c" returned: 0 in 0.473s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:31 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:35:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:31 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98
Apr 15 16:35:31 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:33 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" returned: 0 in 1.892s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:33 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8020a8d9-e229-4dce-b275-a7ac18b2e421]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:33 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c
Apr 15 16:35:33 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:33 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c" returned: 0 in 0.582s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:33 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:35:33 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Converted 1024.00 MB image at 540.66 MB/s
Apr 15 16:35:33 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98 is being set with open permissions: ugo+rw
Apr 15 16:35:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:33 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98
Apr 15 16:35:33 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:34 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" returned: 0 in 0.410s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" released by "_copy_volume_from_snapshot" :: held 3.869s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-174962b1-ea9a-42c2-a1f8-4a53c871fd6c-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" released by "_create_volume_from_snapshot" :: held 3.886s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.894s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c400967-2976-44aa-9dee-2b674ed3d61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98', 'volume_size': 1, 'snapshot_id': '174962b1-ea9a-42c2-a1f8-4a53c871fd6c'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d9fc9a-1b58-4da9-86a8-53e0791a8c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:34 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Volume volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98 (ccdaa6fe-0829-4d6a-9674-eb8b112d6f98): created successfully
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d9fc9a-1b58-4da9-86a8-53e0791a8c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Flow 'volume_create_manager' (8e38eb46-fa78-4ae0-a898-1ce158842ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:34 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-70f2126e-e43c-461d-8e9b-bc8d093f998f tempest-VolumeDependencyTests-270366997 None] Created volume successfully.
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-174962b1-ea9a-42c2-a1f8-4a53c871fd6c-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Lock "cinder-174962b1-ea9a-42c2-a1f8-4a53c871fd6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-42217103-6c3e-4356-b2ab-e264e13d706c" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-42217103-6c3e-4356-b2ab-e264e13d706c" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-174962b1-ea9a-42c2-a1f8-4a53c871fd6c" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-174962b1-ea9a-42c2-a1f8-4a53c871fd6c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Deleting offline snapshot 174962b1-ea9a-42c2-a1f8-4a53c871fd6c of volume 42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] snapshot_file for this snap is: volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacd9c5f-ee62-4ea3-9e2a-f12000c0dc7d]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:34 devstack sudo[89395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c
Apr 15 16:35:34 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:34 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c" returned: 0 in 0.465s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42217103-6c3e-4356-b2ab-e264e13d706c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60b1e6-b9dc-491f-a7fc-d6e85b131e39]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:35 devstack sudo[89400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c
Apr 15 16:35:35 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:35 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:35 devstack sudo[89405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c
Apr 15 16:35:35 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:35 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c" returned: 0 in 0.465s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:35 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c
Apr 15 16:35:35 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:36 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c.174962b1-ea9a-42c2-a1f8-4a53c871fd6c" returned: 0 in 0.408s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-174962b1-ea9a-42c2-a1f8-4a53c871fd6c" released by "_delete_snapshot" :: held 1.859s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-42217103-6c3e-4356-b2ab-e264e13d706c" released by "delete_snapshot" :: held 1.871s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Created reservations ['f7671ffc-7680-4c47-90c1-1f7e1d238c12', '376769eb-a165-4106-9b48-f6799a0a5c06', 'bd513a91-6ec8-4574-a216-2df6d3e099b4', '9f48d5b3-1375-432a-87c7-fa5b50426079'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:36 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Delete snapshot completed successfully.
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8e5473c0-dd0c-4920-98dd-7f3f397d12ed tempest-VolumeDependencyTests-270366997 None] Lock "cinder-174962b1-ea9a-42c2-a1f8-4a53c871fd6c-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-42217103-6c3e-4356-b2ab-e264e13d706c-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-42217103-6c3e-4356-b2ab-e264e13d706c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-42217103-6c3e-4356-b2ab-e264e13d706c" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-42217103-6c3e-4356-b2ab-e264e13d706c" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4238c7d7-95a1-43c9-8257-a13c30588ab9]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:36 devstack sudo[89447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c
Apr 15 16:35:36 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:37 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c" returned: 0 in 0.467s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:37 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c
Apr 15 16:35:37 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:37 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-42217103-6c3e-4356-b2ab-e264e13d706c" returned: 0 in 0.407s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-42217103-6c3e-4356-b2ab-e264e13d706c" released by "delete_volume" :: held 0.902s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Created reservations ['8201c770-2d97-44eb-8429-0c7380bafd3e', 'f606d28d-4e3c-4394-857e-1b301145cbdd', '0475d249-8cd2-4c20-ac63-9b4abf8d83d6', '27554076-93cd-462b-b38c-53c14da31b1d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:37 devstack sudo[89456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:37 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Flow 'volume_create_manager' (944c25dc-72ed-46b0-bc2c-6b2a88fbe580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a75c280-0fcc-4a20-92c6-0280e70b0178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a75c280-0fcc-4a20-92c6-0280e70b0178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1431136391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e56b2d7-2f92-4aba-a461-89b19b1a2480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72f7407378c46d2a69f41c11ad49775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:38Z,use_quota=True,user_id='2adbc99fc99a44fabb54d2fe1ebeba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddffe16-2a0d-43c4-8d64-353db90d30ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddffe16-2a0d-43c4-8d64-353db90d30ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0a03af-dc48-4688-8413-d4ed5f68ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0a03af-dc48-4688-8413-d4ed5f68ce22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e56b2d7-2f92-4aba-a461-89b19b1a2480', 'volume_name': 'volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc248983-f90d-46c9-af2d-27a7aef2eb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc248983-f90d-46c9-af2d-27a7aef2eb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64173dc5-4fea-4ed3-b3a4-ecf8352584c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:37 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Volume 2e56b2d7-2f92-4aba-a461-89b19b1a2480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480', 'volume_size': 1}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1431136391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e56b2d7-2f92-4aba-a461-89b19b1a2480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72f7407378c46d2a69f41c11ad49775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:38Z,use_quota=True,user_id='2adbc99fc99a44fabb54d2fe1ebeba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Creating volume 2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:35:37 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:37 devstack sudo[89459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 1073741824
Apr 15 16:35:37 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:37 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.421s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:37 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Deleted volume successfully.
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-903df37c-ddbd-4544-837b-8817b3bd5e50 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-42217103-6c3e-4356-b2ab-e264e13d706c-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:38 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 1073741824" returned: 0 in 0.481s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:38 devstack sudo[89464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480
Apr 15 16:35:38 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:38 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480" returned: 0 in 0.407s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64173dc5-4fea-4ed3-b3a4-ecf8352584c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff06d1af-817f-4a68-b1f2-3ba09166cbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:38 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Volume volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 (2e56b2d7-2f92-4aba-a461-89b19b1a2480): created successfully
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff06d1af-817f-4a68-b1f2-3ba09166cbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Flow 'volume_create_manager' (944c25dc-72ed-46b0-bc2c-6b2a88fbe580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:38 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-4c42cdb3-b1e3-4633-a206-cdd6295d8749 tempest-VolumeDependencyTests-270366997 None] Created volume successfully.
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Flow 'volume_create_manager' (b438c91f-98bc-4653-aafb-4de019c53dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6b18bb-0e89-481e-9ac0-0818f2524f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6b18bb-0e89-481e-9ac0-0818f2524f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-892927232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f38c864-82d7-42d2-ad75-78dd1df67ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72f7407378c46d2a69f41c11ad49775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2e56b2d7-2f92-4aba-a461-89b19b1a2480,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:40Z,use_quota=True,user_id='2adbc99fc99a44fabb54d2fe1ebeba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bb5a42-4adb-439c-bcd7-600fd60c5a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bb5a42-4adb-439c-bcd7-600fd60c5a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d46a957-1ebd-4913-a991-417e0048f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d46a957-1ebd-4913-a991-417e0048f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4f38c864-82d7-42d2-ad75-78dd1df67ac7', 'volume_name': 'volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7', 'volume_size': 1, 'source_volid': '2e56b2d7-2f92-4aba-a461-89b19b1a2480', 'source_volstatus': 'available'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fd22c6-b20e-4f9f-9bd0-d4ae004d2d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fd22c6-b20e-4f9f-9bd0-d4ae004d2d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fd3164-7f7e-4240-a406-6872022dfa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Volume 4f38c864-82d7-42d2-ad75-78dd1df67ac7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7', 'volume_size': 1, 'source_volid': '2e56b2d7-2f92-4aba-a461-89b19b1a2480', 'source_volstatus': 'available'}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:40 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Cloning volume 2e56b2d7-2f92-4aba-a461-89b19b1a2480 to volume 4f38c864-82d7-42d2-ad75-78dd1df67ac7
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Creating offline snapshot 1667a74d-b5d2-4e7a-894a-f7528fcdeac7 of volume 2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[127a7b46-942b-4487-b9fa-6534bff6de4b]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:40 devstack sudo[89467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480
Apr 15 16:35:40 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:40 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:40 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 1G
Apr 15 16:35:40 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:41 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 1G" returned: 0 in 0.489s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:41 devstack sudo[89477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7
Apr 15 16:35:41 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:41 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7" returned: 0 in 0.407s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:41 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 is being set with open permissions: ugo+rw
Apr 15 16:35:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:41 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7
Apr 15 16:35:41 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:42 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7" returned: 0 in 0.405s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:42 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.info
Apr 15 16:35:42 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:42 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.info" returned: 0 in 0.414s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:42 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.info is being set with open permissions: ugo+rw
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:42 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.info
Apr 15 16:35:42 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:42 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.info" returned: 0 in 0.397s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-4f38c864-82d7-42d2-ad75-78dd1df67ac7" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-4f38c864-82d7-42d2-ad75-78dd1df67ac7" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] snapshot: 1667a74d-b5d2-4e7a-894a-f7528fcdeac7, volume: 4f38c864-82d7-42d2-ad75-78dd1df67ac7,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[75509fe2-30c8-48b4-8e4c-9867b7de77a9]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:43 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7
Apr 15 16:35:43 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:43 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7" returned: 0 in 0.480s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:35:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:35:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:35:43 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a9660b-719b-4192-8ddf-f30fddbf3f80]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:43 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480
Apr 15 16:35:43 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:43 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480" returned: 0 in 0.475s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:43 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:35:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:43 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7
Apr 15 16:35:43 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:45 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7" returned: 0 in 1.906s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:45 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e00f90e-f998-419d-b83d-0731447896e1]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:45 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480
Apr 15 16:35:45 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:46 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480" returned: 0 in 0.593s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:35:46 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Converted 1024.00 MB image at 536.85 MB/s
Apr 15 16:35:46 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7 is being set with open permissions: ugo+rw
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:46 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7
Apr 15 16:35:46 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:46 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7" returned: 0 in 0.403s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-4f38c864-82d7-42d2-ad75-78dd1df67ac7" released by "_copy_volume_from_snapshot" :: held 3.899s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-1667a74d-b5d2-4e7a-894a-f7528fcdeac7" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-1667a74d-b5d2-4e7a-894a-f7528fcdeac7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Deleting offline snapshot 1667a74d-b5d2-4e7a-894a-f7528fcdeac7 of volume 2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] snapshot_file for this snap is: volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[34598e05-9498-44e9-89e1-e20c50146b66]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:46 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7
Apr 15 16:35:46 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:47 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7" returned: 0 in 0.457s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:35:47 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e5397-2b63-42c5-ac10-db95e2c2a7e9]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:47 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480
Apr 15 16:35:47 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:47 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480" returned: 0 in 0.455s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:47 devstack sudo[89532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7
Apr 15 16:35:47 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:48 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7" returned: 0 in 0.442s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:48 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7
Apr 15 16:35:48 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:48 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480.1667a74d-b5d2-4e7a-894a-f7528fcdeac7" returned: 0 in 0.399s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-1667a74d-b5d2-4e7a-894a-f7528fcdeac7" released by "_delete_snapshot" :: held 1.798s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.379s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fd3164-7f7e-4240-a406-6872022dfa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7', 'volume_size': 1, 'source_volid': '2e56b2d7-2f92-4aba-a461-89b19b1a2480', 'source_volstatus': 'available'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95345a12-3c19-48e0-9ae9-a80db14c474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:48 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Volume volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7 (4f38c864-82d7-42d2-ad75-78dd1df67ac7): created successfully
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95345a12-3c19-48e0-9ae9-a80db14c474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Flow 'volume_create_manager' (b438c91f-98bc-4653-aafb-4de019c53dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:48 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1aaea11c-3c71-47f4-880e-78f32afb6ee4 tempest-VolumeDependencyTests-270366997 None] Created volume successfully.
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-2e56b2d7-2f92-4aba-a461-89b19b1a2480-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-2e56b2d7-2f92-4aba-a461-89b19b1a2480-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-2e56b2d7-2f92-4aba-a461-89b19b1a2480" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-2e56b2d7-2f92-4aba-a461-89b19b1a2480" acquired by "delete_volume" :: waited 0.016s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d979013-cb67-4658-88dc-be90ad533a71]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:48 devstack sudo[89542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480
Apr 15 16:35:48 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:49 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480" returned: 0 in 0.470s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:49 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480
Apr 15 16:35:49 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:49 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-2e56b2d7-2f92-4aba-a461-89b19b1a2480" returned: 0 in 0.401s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-2e56b2d7-2f92-4aba-a461-89b19b1a2480" released by "delete_volume" :: held 0.899s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Created reservations ['4d293157-b65e-4d7b-84ec-298e18aca2a7', 'e1ac30a8-170b-4dae-9ff0-5c1dfb4fb6e8', 'e521bb60-4b73-4ae6-b82e-7a2e2aa84cf0', 'c13f7406-bab0-4aad-8486-979f95dbcfbd'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:49 devstack sudo[89550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:49 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:49 devstack sudo[89552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:49 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-4f38c864-82d7-42d2-ad75-78dd1df67ac7-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Lock "cinder-4f38c864-82d7-42d2-ad75-78dd1df67ac7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-4f38c864-82d7-42d2-ad75-78dd1df67ac7" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-4f38c864-82d7-42d2-ad75-78dd1df67ac7" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[097ded79-c887-4630-a478-0925107ce0ae]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:50 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7
Apr 15 16:35:50 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:50 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.463s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:50 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.437s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:50 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Deleted volume successfully.
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d435738a-518f-4d28-ba84-f16a7f1d6058 tempest-VolumeDependencyTests-270366997 None] Lock "cinder-2e56b2d7-2f92-4aba-a461-89b19b1a2480-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:50 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7" returned: 0 in 0.486s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:50 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7
Apr 15 16:35:50 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:50 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4f38c864-82d7-42d2-ad75-78dd1df67ac7" returned: 0 in 0.422s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-4f38c864-82d7-42d2-ad75-78dd1df67ac7" released by "delete_volume" :: held 0.929s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Created reservations ['2576fa45-0399-428f-9508-d0c20308dc27', 'bbd9dc19-2a95-477a-9959-efadc8e1ab97', 'f9fc223a-5576-4f58-8708-bd753588b93f', '9f69daa1-b260-417d-9219-02fbf525381c'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:50 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:50 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Lock "cinder-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Acquiring lock "cinder-quobyte-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8052a285-a050-4aaf-bfb6-92af7398b82a]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:51 devstack sudo[89566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98
Apr 15 16:35:51 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:51 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.454s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Deleted volume successfully.
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-525aad82-2628-462a-aeaf-13839164937e tempest-VolumeDependencyTests-270366997 None] Lock "cinder-4f38c864-82d7-42d2-ad75-78dd1df67ac7-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:51 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" returned: 0 in 0.491s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:51 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98
Apr 15 16:35:51 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:52 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" returned: 0 in 0.411s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Lock "cinder-quobyte-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98" released by "delete_volume" :: held 0.925s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Created reservations ['89c0203e-a726-4886-a61a-e31b12bc7adc', '043830c3-4557-4cfc-8753-9fa567d4d768', 'f63bf512-8545-4d46-8d25-9c97f3ab7c6b', 'ff3719c4-eea5-44fb-9665-1d6a92ae7263'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:52 devstack sudo[89575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:35:52 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:52 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.458s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:35:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Deleted volume successfully.
Apr 15 16:35:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b33e03a0-988b-4f7e-9ebc-fc8e099551ec tempest-VolumeDependencyTests-270366997 None] Lock "cinder-ccdaa6fe-0829-4d6a-9674-eb8b112d6f98-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Flow 'volume_create_manager' (95e286b1-9402-42e1-b910-b8ed1f958fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058cfee1-f19e-4628-a120-4f8e02bf8532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058cfee1-f19e-4628-a120-4f8e02bf8532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2040286653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e71b74-36a2-485f-901f-58e251f730c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833572c4c3134c299f217963bf0cf6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:59Z,use_quota=True,user_id='24db6d4feb534fae93dce8d470a75d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ce2161-4b02-4c8c-aef0-329d63faa261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ce2161-4b02-4c8c-aef0-329d63faa261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4fb59a-3d37-419b-ba9f-dc6d5c570210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4fb59a-3d37-419b-ba9f-dc6d5c570210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e71b74-36a2-485f-901f-58e251f730c5', 'volume_name': 'volume-65e71b74-36a2-485f-901f-58e251f730c5', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a17c47-cb37-4685-b64b-110ff9636e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a17c47-cb37-4685-b64b-110ff9636e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae990d5-887e-4562-8b57-aa66927f34c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Volume 65e71b74-36a2-485f-901f-58e251f730c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e71b74-36a2-485f-901f-58e251f730c5', 'volume_size': 1}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2040286653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e71b74-36a2-485f-901f-58e251f730c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833572c4c3134c299f217963bf0cf6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:59Z,use_quota=True,user_id='24db6d4feb534fae93dce8d470a75d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Creating volume 65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:35:59 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (e64916ae-aeac-4adb-8e7f-78d87e4053ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c631d60c-9d44-4efc-a23f-fc5cd46a6d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack sudo[89620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 1073741824
Apr 15 16:35:59 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c631d60c-9d44-4efc-a23f-fc5cd46a6d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198403885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b177386-90bd-4b82-8428-a95dffa04db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:59Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd73d1af-bbd3-4464-9361-6275ad7ab9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd73d1af-bbd3-4464-9361-6275ad7ab9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2db1867-29a7-49d1-889f-8ca4da794e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2db1867-29a7-49d1-889f-8ca4da794e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b177386-90bd-4b82-8428-a95dffa04db0', 'volume_name': 'volume-7b177386-90bd-4b82-8428-a95dffa04db0', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e18f35-e587-41c9-b977-6cfcfc516e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e18f35-e587-41c9-b977-6cfcfc516e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ec455b-00d9-4b05-bbff-587518b69096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Volume 7b177386-90bd-4b82-8428-a95dffa04db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b177386-90bd-4b82-8428-a95dffa04db0', 'volume_size': 1}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (15718516-6fae-46d1-b6c6-62a8969f9834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097c080b-5a64-4141-9c63-f66a1f84e3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097c080b-5a64-4141-9c63-f66a1f84e3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-925681624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6285a4-5d13-461c-9ae8-4f7e4cfece7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce384ae4-dbc8-400f-8731-ec0acd865bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce384ae4-dbc8-400f-8731-ec0acd865bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363bd5bd-27ed-4d30-8021-b830a15f3938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363bd5bd-27ed-4d30-8021-b830a15f3938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b6285a4-5d13-461c-9ae8-4f7e4cfece7c', 'volume_name': 'volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41acc531-3b2b-418a-9a4f-21c5236ec67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41acc531-3b2b-418a-9a4f-21c5236ec67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68878907-5ca1-45f0-a553-622db925375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Volume 4b6285a4-5d13-461c-9ae8-4f7e4cfece7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c', 'volume_size': 1}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (7353ea10-6eb8-41bf-a695-e4bbb3805be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2278563-dbdb-40a5-a2c0-4c6f4008f014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2278563-dbdb-40a5-a2c0-4c6f4008f014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1415440164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5489174a-79e4-4075-ad32-a4a7ca20f18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df687ab6-071b-48c2-9016-9f71437a3316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df687ab6-071b-48c2-9016-9f71437a3316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9d5ded-bc6d-40fa-a960-80ab3ebc0cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9d5ded-bc6d-40fa-a960-80ab3ebc0cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5489174a-79e4-4075-ad32-a4a7ca20f18c', 'volume_name': 'volume-5489174a-79e4-4075-ad32-a4a7ca20f18c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e926fb74-dafb-4b9f-9ee7-eea8839f4907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e926fb74-dafb-4b9f-9ee7-eea8839f4907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf90109-d8fa-4292-80ea-2260c6efbe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume 5489174a-79e4-4075-ad32-a4a7ca20f18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5489174a-79e4-4075-ad32-a4a7ca20f18c', 'volume_size': 1}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (4dd7e199-fdbb-4b53-bbdc-6b3c26dccc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d13c9d-ad04-4a54-9ce0-7c1e311b905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d13c9d-ad04-4a54-9ce0-7c1e311b905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-902474436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcdc470-6e60-4e1a-9cb4-4da298551cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2258d25-5735-4890-b5b4-4b542e5e05e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2258d25-5735-4890-b5b4-4b542e5e05e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca06e4c2-994f-4cd0-8b87-752d486fb6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca06e4c2-994f-4cd0-8b87-752d486fb6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcdc470-6e60-4e1a-9cb4-4da298551cfb', 'volume_name': 'volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5932934b-d45f-48b0-874d-0216730703cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5932934b-d45f-48b0-874d-0216730703cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9026396b-9a1a-4215-b5ae-b68f44e56039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:35:59 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Volume 6bcdc470-6e60-4e1a-9cb4-4da298551cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb', 'volume_size': 1}
Apr 15 16:35:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (4dbbe776-0a39-47b6-b9bd-37c05ff8d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fac449-a262-4f0c-bb74-1a16a31bf47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fac449-a262-4f0c-bb74-1a16a31bf47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644128884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2cd0911-f3d6-4631-9909-08fe4d2b06a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177de2cb-e2cb-46f3-be0e-1a099d63f7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177de2cb-e2cb-46f3-be0e-1a099d63f7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60abe70c-9f2d-495a-bac4-c3c3515a46b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60abe70c-9f2d-495a-bac4-c3c3515a46b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2cd0911-f3d6-4631-9909-08fe4d2b06a2', 'volume_name': 'volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4de546-6365-4805-a910-264a9b406b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4de546-6365-4805-a910-264a9b406b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffb6820-890e-4d6c-b8a8-505e569c3099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Volume b2cd0911-f3d6-4631-9909-08fe4d2b06a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2', 'volume_size': 1}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 1073741824" returned: 0 in 0.810s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:00 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5
Apr 15 16:36:00 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (d2d3fc01-81e2-4d85-8118-80e3520b717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad23cf3e-5541-4a4a-9dab-e66059b0f9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad23cf3e-5541-4a4a-9dab-e66059b0f9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-187913793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ec0dec-9c29-4529-89a7-7f2daaf8a1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc2753d-4239-496e-905d-8502a92344b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc2753d-4239-496e-905d-8502a92344b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2e98ef-10b9-4d9a-86f7-cd740122b639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2e98ef-10b9-4d9a-86f7-cd740122b639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ec0dec-9c29-4529-89a7-7f2daaf8a1ed', 'volume_name': 'volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb035a0-08ee-4661-b794-24151afa6912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb035a0-08ee-4661-b794-24151afa6912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59af5fd-5937-4468-a9a6-36a2a2d8f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Volume 81ec0dec-9c29-4529-89a7-7f2daaf8a1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed', 'volume_size': 1}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:00 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5" returned: 0 in 0.480s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.214s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198403885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b177386-90bd-4b82-8428-a95dffa04db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:35:59Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Creating volume 7b177386-90bd-4b82-8428-a95dffa04db0 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:00 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae990d5-887e-4562-8b57-aa66927f34c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e71b74-36a2-485f-901f-58e251f730c5', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0 1073741824
Apr 15 16:36:00 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a810712d-303f-41fc-aa65-b15d392e7fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:00 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Volume volume-65e71b74-36a2-485f-901f-58e251f730c5 (65e71b74-36a2-485f-901f-58e251f730c5): created successfully
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a810712d-303f-41fc-aa65-b15d392e7fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:00 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Flow 'volume_create_manager' (95e286b1-9402-42e1-b910-b8ed1f958fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:00 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-4256ef53-4cdd-4aa4-affe-535e0249e8e2 tempest-VolumeDependencyTests-829296961 None] Created volume successfully.
Apr 15 16:36:01 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0 1073741824" returned: 0 in 0.489s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:01 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0
Apr 15 16:36:01 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:01 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0" returned: 0 in 0.529s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.099s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-925681624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6285a4-5d13-461c-9ae8-4f7e4cfece7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Creating volume 4b6285a4-5d13-461c-9ae8-4f7e4cfece7c {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:01 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ec455b-00d9-4b05-bbff-587518b69096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b177386-90bd-4b82-8428-a95dffa04db0', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:01 devstack sudo[89636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c 1073741824
Apr 15 16:36:01 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e154a1f4-01ef-4478-8696-c61f9eb09cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:01 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Volume volume-7b177386-90bd-4b82-8428-a95dffa04db0 (7b177386-90bd-4b82-8428-a95dffa04db0): created successfully
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e154a1f4-01ef-4478-8696-c61f9eb09cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:01 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (e64916ae-aeac-4adb-8e7f-78d87e4053ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:01 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-66d695cc-a726-4639-b232-49517aa54d9f tempest-CreateVolumesFromImageTest-1040547022 None] Created volume successfully.
Apr 15 16:36:02 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c 1073741824" returned: 0 in 0.620s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:02 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c
Apr 15 16:36:02 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:02 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c" returned: 0 in 0.484s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.018s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1415440164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5489174a-79e4-4075-ad32-a4a7ca20f18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Creating volume 5489174a-79e4-4075-ad32-a4a7ca20f18c {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:02 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68878907-5ca1-45f0-a553-622db925375a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3425e8c-c082-4502-8758-b0938ff6c7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:02 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c 1073741824
Apr 15 16:36:02 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:02 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Volume volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c (4b6285a4-5d13-461c-9ae8-4f7e4cfece7c): created successfully
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3425e8c-c082-4502-8758-b0938ff6c7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:02 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (15718516-6fae-46d1-b6c6-62a8969f9834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:02 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6dbf8bcc-6f64-437e-bd8d-d7f2459101c2 tempest-CreateVolumesFromImageTest-1040547022 None] Created volume successfully.
Apr 15 16:36:03 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c 1073741824" returned: 0 in 0.531s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:03 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c
Apr 15 16:36:03 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:03 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c" returned: 0 in 0.478s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.979s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-902474436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcdc470-6e60-4e1a-9cb4-4da298551cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Creating volume 6bcdc470-6e60-4e1a-9cb4-4da298551cfb {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:03 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf90109-d8fa-4292-80ea-2260c6efbe1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5489174a-79e4-4075-ad32-a4a7ca20f18c', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:03 devstack sudo[89652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb 1073741824
Apr 15 16:36:03 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15d78bd-c9d3-43a7-abee-6d0ff4b0805c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:03 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume volume-5489174a-79e4-4075-ad32-a4a7ca20f18c (5489174a-79e4-4075-ad32-a4a7ca20f18c): created successfully
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15d78bd-c9d3-43a7-abee-6d0ff4b0805c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:03 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (7353ea10-6eb8-41bf-a695-e4bbb3805be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:03 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-899c8891-41ee-4a5a-b6fa-6f57c89154e7 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created volume successfully.
Apr 15 16:36:04 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb 1073741824" returned: 0 in 0.546s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:04 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb
Apr 15 16:36:04 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:04 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb" returned: 0 in 0.498s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.818s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644128884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2cd0911-f3d6-4631-9909-08fe4d2b06a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Creating volume b2cd0911-f3d6-4631-9909-08fe4d2b06a2 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:04 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:04 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9026396b-9a1a-4215-b5ae-b68f44e56039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb80d9df-2fb3-4e98-94d0-50c1c91af101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Volume volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb (6bcdc470-6e60-4e1a-9cb4-4da298551cfb): created successfully
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb80d9df-2fb3-4e98-94d0-50c1c91af101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (4dd7e199-fdbb-4b53-bbdc-6b3c26dccc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:05 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-364d80a6-698a-490a-ad16-870a17d71993 tempest-CreateVolumesFromImageTest-1040547022 None] Created volume successfully.
Apr 15 16:36:05 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2 1073741824
Apr 15 16:36:05 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (036e5fdd-8c14-42df-b40f-2dcee9b837b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab12b4d2-dc1a-4b06-bd90-8a8f22b03812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab12b4d2-dc1a-4b06-bd90-8a8f22b03812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1347305691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b89324-e994-407c-8a45-6ae7960da349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:05Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d6b921-9208-4905-b633-ae1a02d4c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d6b921-9208-4905-b633-ae1a02d4c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bbb8be-79f0-4f2f-87e0-6daadf18a2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bbb8be-79f0-4f2f-87e0-6daadf18a2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b89324-e994-407c-8a45-6ae7960da349', 'volume_name': 'volume-d9b89324-e994-407c-8a45-6ae7960da349', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb2cdb0-26aa-4cad-b6ef-c1f729d3e5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb2cdb0-26aa-4cad-b6ef-c1f729d3e5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d6c343-5da7-4b6c-b591-32f6fbaad020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume d9b89324-e994-407c-8a45-6ae7960da349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b89324-e994-407c-8a45-6ae7960da349', 'volume_size': 1}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (cd4574be-e74c-4f7d-b70b-a2dcecb6c1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2617137c-8a55-40a6-8d79-75f4cfc5d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2617137c-8a55-40a6-8d79-75f4cfc5d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175218726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a020a9-e50d-4b49-9932-9f6091496bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:05Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1533bfca-6f17-4fa4-9f3f-92af57b63d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1533bfca-6f17-4fa4-9f3f-92af57b63d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca36fe97-66a1-4ec4-ac2c-6012e3e46ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca36fe97-66a1-4ec4-ac2c-6012e3e46ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a020a9-e50d-4b49-9932-9f6091496bca', 'volume_name': 'volume-83a020a9-e50d-4b49-9932-9f6091496bca', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c038d4d7-a50a-4261-9358-222abd18af33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c038d4d7-a50a-4261-9358-222abd18af33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeec9231-2c17-48b8-ab04-c04f2c912b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume 83a020a9-e50d-4b49-9932-9f6091496bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a020a9-e50d-4b49-9932-9f6091496bca', 'volume_size': 1}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (52b1b902-e1a1-43db-9504-8aad1b36ed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388e00c0-54b9-4def-9ba7-39568cd6d996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388e00c0-54b9-4def-9ba7-39568cd6d996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2100596463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83e2832-64db-4f47-9681-9089730a403f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:05Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6f72fc-1c0a-4acd-8e04-a27c9613f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6f72fc-1c0a-4acd-8e04-a27c9613f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9963953e-eb91-4756-8629-e881fa6be53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9963953e-eb91-4756-8629-e881fa6be53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83e2832-64db-4f47-9681-9089730a403f', 'volume_name': 'volume-f83e2832-64db-4f47-9681-9089730a403f', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9804af43-1491-44a3-aa30-1cdcbdb62014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9804af43-1491-44a3-aa30-1cdcbdb62014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39389de-437f-43f1-906a-8e1d6b50573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume f83e2832-64db-4f47-9681-9089730a403f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83e2832-64db-4f47-9681-9089730a403f', 'volume_size': 1}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:05 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2 1073741824" returned: 0 in 0.708s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:05 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2
Apr 15 16:36:05 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (e4e7a987-77fb-4afd-8952-b86cd0f1c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23574962-4194-4d75-a4fe-9dffb3366f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23574962-4194-4d75-a4fe-9dffb3366f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-475299412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:06Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060dfae8-e076-4a59-9ff6-efb60a6e164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060dfae8-e076-4a59-9ff6-efb60a6e164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713edf65-43a3-42c1-b4c3-5cd89a2d4a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713edf65-43a3-42c1-b4c3-5cd89a2d4a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1', 'volume_name': 'volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517bfa38-3be6-423b-b52d-bf0567d9899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517bfa38-3be6-423b-b52d-bf0567d9899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f92f1b-141a-408a-b407-8b80bc00108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:05 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1', 'volume_size': 1}
Apr 15 16:36:05 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (478bbcd8-293c-4476-9da1-8a1e742692a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e049b0a2-7adb-4b6a-9bde-8f6a12024e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e049b0a2-7adb-4b6a-9bde-8f6a12024e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752352982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90708b5e-547f-4392-9cab-7d3ffef53f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:06Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82776def-4f36-4ebb-9535-b838be5af8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82776def-4f36-4ebb-9535-b838be5af8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c264c63f-d827-43ac-af82-3ce491cea18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c264c63f-d827-43ac-af82-3ce491cea18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90708b5e-547f-4392-9cab-7d3ffef53f32', 'volume_name': 'volume-90708b5e-547f-4392-9cab-7d3ffef53f32', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ee7ce7-4fb1-46c2-91cd-cff10727fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ee7ce7-4fb1-46c2-91cd-cff10727fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba10920c-3cfa-4f96-9763-881ce5290b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:06 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume 90708b5e-547f-4392-9cab-7d3ffef53f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90708b5e-547f-4392-9cab-7d3ffef53f32', 'volume_size': 1}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:06 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2" returned: 0 in 0.611s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.916s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-187913793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ec0dec-9c29-4529-89a7-7f2daaf8a1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339d98532a5d4081923192acc296f68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:00Z,use_quota=True,user_id='1b056dec70a7460e8075d722a14216da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Creating volume 81ec0dec-9c29-4529-89a7-7f2daaf8a1ed {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:06 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffb6820-890e-4d6c-b8a8-505e569c3099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736db619-b1a5-47a8-b0c4-bc2c76b294a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:06 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed 1073741824
Apr 15 16:36:06 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:06 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Volume volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2 (b2cd0911-f3d6-4631-9909-08fe4d2b06a2): created successfully
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736db619-b1a5-47a8-b0c4-bc2c76b294a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (4dbbe776-0a39-47b6-b9bd-37c05ff8d15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:06 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-475f04b6-2a87-4c3e-8daf-2e18095134b0 tempest-CreateVolumesFromImageTest-1040547022 None] Created volume successfully.
Apr 15 16:36:06 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed 1073741824" returned: 0 in 0.581s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:06 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:06 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed
Apr 15 16:36:06 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:07 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed" returned: 0 in 0.484s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.727s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59af5fd-5937-4468-a9a6-36a2a2d8f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64071b3-990b-4f28-a1b1-9bc5eeefa0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Creating offline snapshot 2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 of volume 65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:36:07 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Volume volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed (81ec0dec-9c29-4529-89a7-7f2daaf8a1ed): created successfully
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64071b3-990b-4f28-a1b1-9bc5eeefa0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Flow 'volume_create_manager' (d2d3fc01-81e2-4d85-8118-80e3520b717c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6257551-13a9-4f70-b9cc-69f0e5be7923]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:07 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-4da36453-01af-4ac4-8e1a-ef026f191d7e tempest-CreateVolumesFromImageTest-1040547022 None] Created volume successfully.
Apr 15 16:36:07 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5
Apr 15 16:36:07 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=91,cinder:UPDATE=120,cinder:INSERT=27,cinder:DELETE=8 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:36:07 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=84,cinder:INSERT=23,cinder:DELETE=13,cinder:UPDATE=98 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-quobyte-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d28270-1e88-496e-a7f6-9ada08d0da03]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:08 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5" returned: 0 in 0.604s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:08 devstack sudo[89684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 1G
Apr 15 16:36:08 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:08 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed
Apr 15 16:36:08 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:08 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed" returned: 0 in 0.516s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:08 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed
Apr 15 16:36:08 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:08 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 1G" returned: 0 in 0.540s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:08 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e71b74-36a2-485f-901f-58e251f730c5 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:08 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e71b74-36a2-485f-901f-58e251f730c5 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5
Apr 15 16:36:08 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:09 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed" returned: 0 in 0.484s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed" released by "delete_volume" :: held 1.028s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Created reservations ['b71e8726-451d-417d-b39f-b4a0ad342d04', 'e2071c3f-68d8-41d2-b721-5bd905ae3521', '0d220359-f256-4778-994d-7da4da07126e', 'a29ec268-d2e5-4ec4-a294-11d407efd614'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:09 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e71b74-36a2-485f-901f-58e251f730c5 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5" returned: 0 in 0.530s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:09 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 is being set with open permissions: ugo+rw
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:09 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:09 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:09 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5
Apr 15 16:36:09 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:09 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.434s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:09 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Deleted volume successfully.
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5f5eaec7-6fef-4d46-bfe8-1908d45873e1 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-81ec0dec-9c29-4529-89a7-7f2daaf8a1ed-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:09 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5" returned: 0 in 0.461s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:09 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:09 devstack sudo[89707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.info
Apr 15 16:36:09 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:10 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.info" returned: 0 in 0.436s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:10 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.info is being set with open permissions: ugo+rw
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:10 devstack sudo[89710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.info
Apr 15 16:36:10 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-b2cd0911-f3d6-4631-9909-08fe4d2b06a2-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-b2cd0911-f3d6-4631-9909-08fe4d2b06a2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-quobyte-b2cd0911-f3d6-4631-9909-08fe4d2b06a2" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-b2cd0911-f3d6-4631-9909-08fe4d2b06a2" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a443e2e4-530b-4cb5-b861-7ff6c2e48d5f]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:10 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2
Apr 15 16:36:10 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:10 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.info" returned: 0 in 0.471s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.120s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.421s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1347305691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b89324-e994-407c-8a45-6ae7960da349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:05Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Creating volume d9b89324-e994-407c-8a45-6ae7960da349 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:10 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:10 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e0af0cbf-6826-4ca0-b71d-54a69b8b5f1d tempest-VolumeDependencyTests-829296961 None] Create snapshot completed successfully
Apr 15 16:36:10 devstack sudo[89715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349 1073741824
Apr 15 16:36:10 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:10 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2" returned: 0 in 0.574s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:10 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:10 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2
Apr 15 16:36:10 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:11 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-b2cd0911-f3d6-4631-9909-08fe4d2b06a2" returned: 0 in 0.487s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-b2cd0911-f3d6-4631-9909-08fe4d2b06a2" released by "delete_volume" :: held 1.083s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Created reservations ['85675d5c-ef85-44f7-a49e-2cda56033fd6', '348d8d17-e323-4a58-ab04-49b6c0dfe2a4', '72f0df9f-2ec8-4dd7-83f5-06b675181ef3', 'ce0c4ce1-470a-4ac3-8afc-9e5ae73c3b47'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Flow 'volume_create_manager' (95a7f304-dab4-43f9-8bc8-589fe4bf4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b8184b-7571-4b7b-a0f8-9bfa72f1e286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:11 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349 1073741824" returned: 0 in 0.846s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:11 devstack sudo[89726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:11 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b8184b-7571-4b7b-a0f8-9bfa72f1e286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-572755952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbd503e-f19f-4a1a-8795-4e787ba9af31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833572c4c3134c299f217963bf0cf6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2dfb1994-b4a2-4629-b0bd-dc2fb62425e5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:11Z,use_quota=True,user_id='24db6d4feb534fae93dce8d470a75d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0b9554-30ad-4945-9d32-3fc260b28720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0b9554-30ad-4945-9d32-3fc260b28720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0598cf6-c29d-4cb6-b4a4-684dbcd693ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0598cf6-c29d-4cb6-b4a4-684dbcd693ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1bbd503e-f19f-4a1a-8795-4e787ba9af31', 'volume_name': 'volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31', 'volume_size': 1, 'snapshot_id': '2dfb1994-b4a2-4629-b0bd-dc2fb62425e5'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5a698a-5f41-4411-9295-9356c9ecaf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5a698a-5f41-4411-9295-9356c9ecaf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22752693-4c06-4032-b8d4-b06b3a96e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:11 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Volume 1bbd503e-f19f-4a1a-8795-4e787ba9af31: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31', 'volume_size': 1, 'snapshot_id': '2dfb1994-b4a2-4629-b0bd-dc2fb62425e5'}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:11 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349
Apr 15 16:36:11 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:11 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.497s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:11 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Deleted volume successfully.
Apr 15 16:36:11 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-b4af7880-6e8c-4756-b5db-6685d376bf8c tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-b2cd0911-f3d6-4631-9909-08fe4d2b06a2-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:12 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349" returned: 0 in 0.633s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.742s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175218726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a020a9-e50d-4b49-9932-9f6091496bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:05Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Creating volume 83a020a9-e50d-4b49-9932-9f6091496bca {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:12 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:12 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca 1073741824
Apr 15 16:36:12 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d6c343-5da7-4b6c-b591-32f6fbaad020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b89324-e994-407c-8a45-6ae7960da349', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a42b681-bec7-4858-9ad1-141add3440b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:12 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume volume-d9b89324-e994-407c-8a45-6ae7960da349 (d9b89324-e994-407c-8a45-6ae7960da349): created successfully
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a42b681-bec7-4858-9ad1-141add3440b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (036e5fdd-8c14-42df-b40f-2dcee9b837b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:12 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9f177679-e089-4b78-b52e-a14bf7ebd443 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created volume successfully.
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-6bcdc470-6e60-4e1a-9cb4-4da298551cfb-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-6bcdc470-6e60-4e1a-9cb4-4da298551cfb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-quobyte-6bcdc470-6e60-4e1a-9cb4-4da298551cfb" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-6bcdc470-6e60-4e1a-9cb4-4da298551cfb" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a70de90-c026-4640-9cdc-d48fdf2a0b3e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:12 devstack sudo[89734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb
Apr 15 16:36:12 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:12 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca 1073741824" returned: 0 in 0.704s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:12 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:12 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca
Apr 15 16:36:12 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:13 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb" returned: 0 in 0.618s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:13 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb
Apr 15 16:36:13 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:13 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca" returned: 0 in 0.423s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.714s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2100596463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83e2832-64db-4f47-9681-9089730a403f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:05Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Creating volume f83e2832-64db-4f47-9681-9089730a403f {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:13 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:13 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f 1073741824
Apr 15 16:36:13 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeec9231-2c17-48b8-ab04-c04f2c912b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a020a9-e50d-4b49-9932-9f6091496bca', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11440ce-f35b-4a08-afe0-b6a90086ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:13 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume volume-83a020a9-e50d-4b49-9932-9f6091496bca (83a020a9-e50d-4b49-9932-9f6091496bca): created successfully
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11440ce-f35b-4a08-afe0-b6a90086ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (cd4574be-e74c-4f7d-b70b-a2dcecb6c1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:13 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c8afe677-e356-4654-acdf-c8bd149ba99e tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created volume successfully.
Apr 15 16:36:13 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-6bcdc470-6e60-4e1a-9cb4-4da298551cfb" returned: 0 in 0.459s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-6bcdc470-6e60-4e1a-9cb4-4da298551cfb" released by "delete_volume" :: held 1.109s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Created reservations ['e7c70ce8-be3e-402d-b40b-7a5c52d11425', '87f6ac54-4a39-48e8-be7e-3e9a9453407b', 'ca26d5c4-938c-4f21-a203-45b66fbf38d6', '5e0e19fb-2916-4c56-8b02-ae4b87bee609'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:13 devstack sudo[89750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:13 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:13 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f 1073741824" returned: 0 in 0.592s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:13 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:13 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f
Apr 15 16:36:13 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:14 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.497s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:14 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Deleted volume successfully.
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c6f2d17d-9a7c-41c9-af66-adf246c26c04 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-6bcdc470-6e60-4e1a-9cb4-4da298551cfb-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:14 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f" returned: 0 in 0.573s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.590s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-475299412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:06Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Creating volume c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:14 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39389de-437f-43f1-906a-8e1d6b50573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83e2832-64db-4f47-9681-9089730a403f', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:14 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1 1073741824
Apr 15 16:36:14 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d6ef2c-ddc9-41f7-8cc8-ad750a5c69c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:14 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume volume-f83e2832-64db-4f47-9681-9089730a403f (f83e2832-64db-4f47-9681-9089730a403f): created successfully
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d6ef2c-ddc9-41f7-8cc8-ad750a5c69c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (52b1b902-e1a1-43db-9504-8aad1b36ed88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:14 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-df688891-97ad-429c-888d-d06768f11611 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created volume successfully.
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-quobyte-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c" acquired by "delete_volume" :: waited 0.019s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be1af4e-34bd-4094-b7e4-802bc70eb8b0]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:14 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:14 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c
Apr 15 16:36:14 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:15 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1 1073741824" returned: 0 in 0.613s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:15 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1
Apr 15 16:36:15 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:15 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c" returned: 0 in 0.582s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:15 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c
Apr 15 16:36:15 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Flow 'volume_create_manager' (3870aa6a-cf38-4773-a809-8c70657f8be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46727be5-2c18-462c-8027-4c9a7d6e2c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46727be5-2c18-462c-8027-4c9a7d6e2c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1302641721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086938a2-aecc-4690-a0fd-5919c14216bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602768aecb644bf2850d4419b4acd4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:15Z,use_quota=True,user_id='2a205c35e36f4b268e5d03f392691d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7038cd49-c569-49b3-829e-7400915b6b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7038cd49-c569-49b3-829e-7400915b6b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62727a25-3793-4d36-8d82-02fc004c4735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62727a25-3793-4d36-8d82-02fc004c4735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086938a2-aecc-4690-a0fd-5919c14216bd', 'volume_name': 'volume-086938a2-aecc-4690-a0fd-5919c14216bd', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b063b3-281c-4825-b707-a81f8b7503b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b063b3-281c-4825-b707-a81f8b7503b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14c9d16-9fb4-4019-a67c-8d6510f8dc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:15 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Volume 086938a2-aecc-4690-a0fd-5919c14216bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086938a2-aecc-4690-a0fd-5919c14216bd', 'volume_size': 1}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:15 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.564s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752352982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90708b5e-547f-4392-9cab-7d3ffef53f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc5eea4cf30413d8d784543e1733048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:06Z,use_quota=True,user_id='6ac9b71fdf9f4aedb5555fd1519fe2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Creating volume 90708b5e-547f-4392-9cab-7d3ffef53f32 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:15 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f92f1b-141a-408a-b407-8b80bc00108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:15 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32 1073741824
Apr 15 16:36:15 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bec7cf0-c374-4020-b369-2f983faa320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:15 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1 (c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1): created successfully
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bec7cf0-c374-4020-b369-2f983faa320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (e4e7a987-77fb-4afd-8952-b86cd0f1c728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:15 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-def80dbe-f5fe-411b-a257-71603cb3f41d tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created volume successfully.
Apr 15 16:36:15 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c" returned: 0 in 0.433s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c" released by "delete_volume" :: held 1.045s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Created reservations ['87d3174d-399e-4cf1-8d13-8e9df202476b', '72a5d939-c46a-440d-b46a-338cd842a5e0', '1ef59d6e-0cb2-4398-a17e-57236edb4705', 'd0e645f7-b51a-4bf9-8be8-6dc1ea26b022'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:15 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:15 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:15 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:16 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32 1073741824" returned: 0 in 0.518s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:16 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32
Apr 15 16:36:16 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:16 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.434s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:16 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Deleted volume successfully.
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-aff2a3fe-fb62-4d88-972e-1d2c1f2aadf5 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-4b6285a4-5d13-461c-9ae8-4f7e4cfece7c-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:16 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32" returned: 0 in 0.415s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.113s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-2dfb1994-b4a2-4629-b0bd-dc2fb62425e5-1bbd503e-f19f-4a1a-8795-4e787ba9af31" by "_create_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba10920c-3cfa-4f96-9763-881ce5290b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90708b5e-547f-4392-9cab-7d3ffef53f32', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c05f8e-89a5-4d8a-bcb3-de20dcedcaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:16 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Volume volume-90708b5e-547f-4392-9cab-7d3ffef53f32 (90708b5e-547f-4392-9cab-7d3ffef53f32): created successfully
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c05f8e-89a5-4d8a-bcb3-de20dcedcaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Flow 'volume_create_manager' (478bbcd8-293c-4476-9da1-8a1e742692a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-2dfb1994-b4a2-4629-b0bd-dc2fb62425e5-1bbd503e-f19f-4a1a-8795-4e787ba9af31" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Creating volume 1bbd503e-f19f-4a1a-8795-4e787ba9af31 from snapshot 2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 {{(pid=82156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-1bbd503e-f19f-4a1a-8795-4e787ba9af31" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:16 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-28699806-9ef9-4689-971d-4415a37c929f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created volume successfully.
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-1bbd503e-f19f-4a1a-8795-4e787ba9af31" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] snapshot: 2dfb1994-b4a2-4629-b0bd-dc2fb62425e5, volume: 1bbd503e-f19f-4a1a-8795-4e787ba9af31,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f49171-2314-4f67-a82d-0527e67f1cda]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:16 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5
Apr 15 16:36:16 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-7b177386-90bd-4b82-8428-a95dffa04db0-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-90708b5e-547f-4392-9cab-7d3ffef53f32-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-7b177386-90bd-4b82-8428-a95dffa04db0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-90708b5e-547f-4392-9cab-7d3ffef53f32-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "cinder-quobyte-7b177386-90bd-4b82-8428-a95dffa04db0" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-7b177386-90bd-4b82-8428-a95dffa04db0" acquired by "delete_volume" :: waited 0.013s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-quobyte-90708b5e-547f-4392-9cab-7d3ffef53f32" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac442029-e85e-408c-9d07-3ab021b491d6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-90708b5e-547f-4392-9cab-7d3ffef53f32" acquired by "delete_volume" :: waited 0.019s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f889f55b-82aa-448d-9288-3dc9d8f44bb2]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:16 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:16 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0
Apr 15 16:36:16 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:17 devstack sudo[89789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32
Apr 15 16:36:17 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:17 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5" returned: 0 in 0.507s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65e71b74-36a2-485f-901f-58e251f730c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[72596afd-0840-4e6e-b25d-95b872eb3acc]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:17 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5
Apr 15 16:36:17 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:17 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:17 devstack sudo[89803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0
Apr 15 16:36:17 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:17 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32" returned: 0 in 0.484s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:17 devstack sudo[89805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32
Apr 15 16:36:17 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:17 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5" returned: 0 in 0.494s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:17 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31
Apr 15 16:36:17 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:17 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7b177386-90bd-4b82-8428-a95dffa04db0" returned: 0 in 0.433s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-quobyte-7b177386-90bd-4b82-8428-a95dffa04db0" released by "delete_volume" :: held 0.941s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Created reservations ['c43b304d-cb3a-4d7c-a674-6bef35f30aac', 'c48407e7-9735-4755-96e6-04a18a5eda1b', '42ad3633-3da6-4f8d-88bd-cbada60f4884', '8a55b641-8bbd-45ab-98fe-372f7b1725ee'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:17 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-90708b5e-547f-4392-9cab-7d3ffef53f32" returned: 0 in 0.464s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-90708b5e-547f-4392-9cab-7d3ffef53f32" released by "delete_volume" :: held 0.987s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:17 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:17 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:17 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created reservations ['825e96ee-cb22-4e50-8894-9a3e232f20f9', 'f2014e78-3586-4b69-ae82-ce6d98370570', '819f91e7-b4c2-4598-8d98-d86a0421a85b', '0a959bd1-965a-4a3a-91f6-f48bc34539ba'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:18 devstack sudo[89817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:18 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:18 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.825s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:18 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Deleted volume successfully.
Apr 15 16:36:18 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.948s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:18 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Deleted volume successfully.
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cc8877ce-50a0-4e98-95f8-dc5a5622ea81 tempest-CreateVolumesFromImageTest-1040547022 None] Lock "cinder-7b177386-90bd-4b82-8428-a95dffa04db0-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:18 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-7f839087-5f31-4eb4-a45e-c9ea9c3bba96 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-90708b5e-547f-4392-9cab-7d3ffef53f32-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-quobyte-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:19 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1" acquired by "delete_volume" :: waited 0.021s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:19 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d7413d-dd17-4be9-b01e-5eb5e5f4a7d6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:19 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:19 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1
Apr 15 16:36:19 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:20 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31" returned: 0 in 2.474s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2256a250-4515-49ac-beb5-20bd14c5397f]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:20 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1" returned: 0 in 0.941s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:20 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1
Apr 15 16:36:20 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:20 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5
Apr 15 16:36:20 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:20 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1" returned: 0 in 0.414s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1" released by "delete_volume" :: held 1.401s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created reservations ['c35c90c8-a6fa-4998-87b8-da0121b872ae', '7686008f-a8c8-46df-9d13-3845a089ef28', 'd7dad1fb-f0c1-4b83-ab96-3f69611235c1', '6ef5db3e-723f-4abe-a4dc-36869862133f'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:20 devstack sudo[89843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:20 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:20 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5" returned: 0 in 0.699s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:36:20 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Converted 1024.00 MB image at 413.74 MB/s
Apr 15 16:36:20 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31 is being set with open permissions: ugo+rw
Apr 15 16:36:20 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:20 devstack sudo[89846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31
Apr 15 16:36:20 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (927a7f89-fab4-4e57-adc1-7aac257cb51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4248e601-bd8c-4d9b-8e35-292b8d564f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4248e601-bd8c-4d9b-8e35-292b8d564f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1447323946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833178df-4585-4d7b-ad8f-222140d67b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:21Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d888da8-461c-4e40-ae2d-ac938282f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d888da8-461c-4e40-ae2d-ac938282f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15b211c-c169-40d3-9598-fd27680a310d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15b211c-c169-40d3-9598-fd27680a310d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '833178df-4585-4d7b-ad8f-222140d67b1e', 'volume_name': 'volume-833178df-4585-4d7b-ad8f-222140d67b1e', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27b918e-c414-44bc-bb3d-9e0e3fabfe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27b918e-c414-44bc-bb3d-9e0e3fabfe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907aa106-cdf0-4d21-a537-b18fac4cfb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:21 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume 833178df-4585-4d7b-ad8f-222140d67b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-833178df-4585-4d7b-ad8f-222140d67b1e', 'volume_size': 1}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:21 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:21 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Deleted volume successfully.
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-61d4da30-be4a-4cd8-b633-fefce8eb8259 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-c8ebf92b-6c22-4019-86f1-ea99fe6b6aa1-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-f83e2832-64db-4f47-9681-9089730a403f-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-f83e2832-64db-4f47-9681-9089730a403f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:21 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31" returned: 0 in 0.455s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-quobyte-f83e2832-64db-4f47-9681-9089730a403f" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-1bbd503e-f19f-4a1a-8795-4e787ba9af31" released by "_copy_volume_from_snapshot" :: held 4.693s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-2dfb1994-b4a2-4629-b0bd-dc2fb62425e5-1bbd503e-f19f-4a1a-8795-4e787ba9af31" released by "_create_volume_from_snapshot" :: held 4.715s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.745s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.779s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1302641721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086938a2-aecc-4690-a0fd-5919c14216bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602768aecb644bf2850d4419b4acd4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:15Z,use_quota=True,user_id='2a205c35e36f4b268e5d03f392691d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Creating volume 086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:21 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-f83e2832-64db-4f47-9681-9089730a403f" acquired by "delete_volume" :: waited 0.035s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:21 devstack sudo[89850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd 1073741824
Apr 15 16:36:21 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd81143-165c-4d1b-8475-03dea033967e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22752693-4c06-4032-b8d4-b06b3a96e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31', 'volume_size': 1, 'snapshot_id': '2dfb1994-b4a2-4629-b0bd-dc2fb62425e5'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e271e48e-bae2-4301-86d5-2cfc90bdf4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:21 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Volume volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31 (1bbd503e-f19f-4a1a-8795-4e787ba9af31): created successfully
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e271e48e-bae2-4301-86d5-2cfc90bdf4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Flow 'volume_create_manager' (95a7f304-dab4-43f9-8bc8-589fe4bf4de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:21 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-3d44718b-7f03-48e1-a45b-d863d65eca9c tempest-VolumeDependencyTests-829296961 None] Created volume successfully.
Apr 15 16:36:21 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f
Apr 15 16:36:21 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:21 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd 1073741824" returned: 0 in 0.490s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:21 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f" returned: 0 in 0.487s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:21 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:21 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd
Apr 15 16:36:21 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:21 devstack sudo[89861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f
Apr 15 16:36:21 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-2dfb1994-b4a2-4629-b0bd-dc2fb62425e5-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-2dfb1994-b4a2-4629-b0bd-dc2fb62425e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-65e71b74-36a2-485f-901f-58e251f730c5" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-65e71b74-36a2-485f-901f-58e251f730c5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-2dfb1994-b4a2-4629-b0bd-dc2fb62425e5" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-2dfb1994-b4a2-4629-b0bd-dc2fb62425e5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Deleting offline snapshot 2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 of volume 65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] snapshot_file for this snap is: volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4dbc24-2a7d-49f2-afaf-bf62c171cf19]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:22 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5
Apr 15 16:36:22 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:22 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-f83e2832-64db-4f47-9681-9089730a403f" returned: 0 in 0.432s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:22 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd" returned: 0 in 0.453s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-f83e2832-64db-4f47-9681-9089730a403f" released by "delete_volume" :: held 0.955s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1447323946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833178df-4585-4d7b-ad8f-222140d67b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:21Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Creating volume 833178df-4585-4d7b-ad8f-222140d67b1e {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:22 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14c9d16-9fb4-4019-a67c-8d6510f8dc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086938a2-aecc-4690-a0fd-5919c14216bd', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f6011a-0589-4a01-ae2a-581a39b8b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:22 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e 1073741824
Apr 15 16:36:22 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:22 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Volume volume-086938a2-aecc-4690-a0fd-5919c14216bd (086938a2-aecc-4690-a0fd-5919c14216bd): created successfully
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f6011a-0589-4a01-ae2a-581a39b8b177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Flow 'volume_create_manager' (3870aa6a-cf38-4773-a809-8c70657f8be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1b8882ae-fb76-4457-90d2-18e40388b1de tempest-SnapshotDependencyTests-1627030888 None] Created volume successfully.
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created reservations ['d41269ed-acdd-4b77-b13a-b5ea47c94eb8', '5ac64b3b-146f-4339-8775-87c16bfddb1d', '85619432-c2b4-4400-9172-24df8db14dec', '417ca494-db63-4f13-be83-1e99aded78f9'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:22 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:22 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:22 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5" returned: 0 in 0.483s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65e71b74-36a2-485f-901f-58e251f730c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[823bf28b-f8a4-4fc4-92b1-e3eb88067fb6]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:22 devstack sudo[89875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5
Apr 15 16:36:22 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:22 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e 1073741824" returned: 0 in 0.516s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:22 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.432s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:22 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e
Apr 15 16:36:22 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:22 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Deleted volume successfully.
Apr 15 16:36:22 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ff851e50-d9a8-4aa9-92d5-061be5b3d9ea tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-f83e2832-64db-4f47-9681-9089730a403f-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:23 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5" returned: 0 in 0.501s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:23 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5
Apr 15 16:36:23 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:23 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e" returned: 0 in 0.450s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.120s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907aa106-cdf0-4d21-a537-b18fac4cfb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-833178df-4585-4d7b-ad8f-222140d67b1e', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f770bc6-7c99-43dc-99d1-00f068dfc655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Creating offline snapshot cd62fcdd-685b-48a4-9734-3ce68ae01da6 of volume 086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:36:23 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume volume-833178df-4585-4d7b-ad8f-222140d67b1e (833178df-4585-4d7b-ad8f-222140d67b1e): created successfully
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f770bc6-7c99-43dc-99d1-00f068dfc655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (927a7f89-fab4-4e57-adc1-7aac257cb51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf715ce2-72e9-4087-8f36-3529e7e24ff1]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:23 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-94bef90d-55cf-415d-abdc-ca7b82c77d41 tempest-CreateVolumesFromSnapshotTest-767878613 None] Created volume successfully.
Apr 15 16:36:23 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd
Apr 15 16:36:23 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-83a020a9-e50d-4b49-9932-9f6091496bca-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-83a020a9-e50d-4b49-9932-9f6091496bca-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-quobyte-83a020a9-e50d-4b49-9932-9f6091496bca" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-83a020a9-e50d-4b49-9932-9f6091496bca" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b6759c-31bc-452a-8ba8-f4665978db34]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:23 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca
Apr 15 16:36:23 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:23 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5" returned: 0 in 0.541s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:23 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5
Apr 15 16:36:23 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:23 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd" returned: 0 in 0.496s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:23 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:23 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 1G
Apr 15 16:36:23 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:24 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca" returned: 0 in 0.489s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:24 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5.2dfb1994-b4a2-4629-b0bd-dc2fb62425e5" returned: 0 in 0.404s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:24 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca
Apr 15 16:36:24 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-2dfb1994-b4a2-4629-b0bd-dc2fb62425e5" released by "_delete_snapshot" :: held 1.987s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-65e71b74-36a2-485f-901f-58e251f730c5" released by "delete_snapshot" :: held 2.000s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Created reservations ['155d6dc1-13cd-4ff4-9ca5-d91bbc44566a', 'ecd002d5-f1a9-467a-b0dd-8bc2cf9f9e2d', '96ee80b7-148b-4842-be33-09aad6e26710', '379722cb-1003-4944-83ce-6081c9f9e1e8'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:24 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Delete snapshot completed successfully.
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1b53aedd-a7b3-448d-8443-9c7891d48673 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-2dfb1994-b4a2-4629-b0bd-dc2fb62425e5-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-65e71b74-36a2-485f-901f-58e251f730c5-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-65e71b74-36a2-485f-901f-58e251f730c5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-65e71b74-36a2-485f-901f-58e251f730c5" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-65e71b74-36a2-485f-901f-58e251f730c5" acquired by "delete_volume" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3663cd4e-cc84-4852-9bed-04e8ff150861]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:24 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5
Apr 15 16:36:24 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:24 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 1G" returned: 0 in 0.566s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086938a2-aecc-4690-a0fd-5919c14216bd -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:24 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086938a2-aecc-4690-a0fd-5919c14216bd -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6
Apr 15 16:36:24 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:24 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-83a020a9-e50d-4b49-9932-9f6091496bca" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-83a020a9-e50d-4b49-9932-9f6091496bca" released by "delete_volume" :: held 0.979s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created reservations ['c7bd03c3-268b-4322-b733-3c2ad543fc0e', 'c772c97b-a9c4-41bc-991e-7b4cf1e4de19', '8a33e96c-e964-4bdb-861d-92dc56c470f7', 'beffabea-f261-47e8-afd6-e116fbd61921'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:24 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:24 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:24 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5" returned: 0 in 0.541s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:24 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5
Apr 15 16:36:24 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:24 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086938a2-aecc-4690-a0fd-5919c14216bd -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6" returned: 0 in 0.449s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:24 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 is being set with open permissions: ugo+rw
Apr 15 16:36:24 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:24 devstack sudo[89928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6
Apr 15 16:36:24 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:25 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.432s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:25 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Deleted volume successfully.
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-248df0a0-1251-4db5-9e31-8bcd21e8144f tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-83a020a9-e50d-4b49-9932-9f6091496bca-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:25 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-65e71b74-36a2-485f-901f-58e251f730c5" returned: 0 in 0.452s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-65e71b74-36a2-485f-901f-58e251f730c5" released by "delete_volume" :: held 1.026s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Created reservations ['6ca200f7-1c60-4b56-9d44-16c897f3ac3a', '0debd371-5284-45d3-868c-f0f701591f1f', '7198c4b1-b3e3-456a-8bf7-8f51584ac74c', '62c46253-49ef-4293-916e-03dcd325de17'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:25 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6" returned: 0 in 0.437s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:25 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.info
Apr 15 16:36:25 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:25 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:25 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-d9b89324-e994-407c-8a45-6ae7960da349-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-d9b89324-e994-407c-8a45-6ae7960da349-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-quobyte-d9b89324-e994-407c-8a45-6ae7960da349" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-d9b89324-e994-407c-8a45-6ae7960da349" acquired by "delete_volume" :: waited 0.020s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de42779-b200-4fee-ad76-dff96371e412]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:25 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.info" returned: 0 in 0.424s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:25 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.info is being set with open permissions: ugo+rw
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:25 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349
Apr 15 16:36:25 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:25 devstack sudo[89940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.info
Apr 15 16:36:25 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:25 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.451s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:25 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Deleted volume successfully.
Apr 15 16:36:25 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d14d9495-e018-4950-be1c-a54ec3dbcfa7 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-65e71b74-36a2-485f-901f-58e251f730c5-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:26 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.info" returned: 0 in 0.406s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:26 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.801s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349" returned: 0 in 0.494s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Creating offline snapshot 67fd1ba4-49d6-40a9-9b8c-8804f233aca9 of volume 833178df-4585-4d7b-ad8f-222140d67b1e {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:36:26 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349
Apr 15 16:36:26 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:26 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-49fc9def-75c1-44f0-8552-7071be8ac114 tempest-SnapshotDependencyTests-1627030888 None] Create snapshot completed successfully
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9007e05a-5497-4090-8861-97d454a51daf]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:26 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e
Apr 15 16:36:26 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:26 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Flow 'volume_create_manager' (8956b510-11e6-4e24-a249-768d32c57d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f4e355-bb95-4c4a-8104-76b153053550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f4e355-bb95-4c4a-8104-76b153053550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1725036807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e20f1e0-bb82-42f1-8ccb-6e375b896e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833572c4c3134c299f217963bf0cf6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:27Z,use_quota=True,user_id='24db6d4feb534fae93dce8d470a75d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a98a271-c24d-4239-8c1d-2ffc83d2c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a98a271-c24d-4239-8c1d-2ffc83d2c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd426bc-6ffd-430b-8188-778407321c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd426bc-6ffd-430b-8188-778407321c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e20f1e0-bb82-42f1-8ccb-6e375b896e09', 'volume_name': 'volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef287f4-e905-4c0b-bb4d-40e7e444526b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef287f4-e905-4c0b-bb4d-40e7e444526b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c7cb5d-05a2-4500-98e8-3952075ac620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Volume 9e20f1e0-bb82-42f1-8ccb-6e375b896e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09', 'volume_size': 1}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-d9b89324-e994-407c-8a45-6ae7960da349" returned: 0 in 0.512s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-d9b89324-e994-407c-8a45-6ae7960da349" released by "delete_volume" :: held 1.033s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created reservations ['9397b77b-74df-4add-8262-6f2ac2eaaf9e', '1b5b21a6-f93a-414a-b909-c2f82aa247ee', '24c3721d-7caf-4aec-b8d3-2c912dc59c1d', '5aa89cb2-7c66-4b30-bfd6-1b1889f32f0d'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Flow 'volume_create_manager' (f9688c6c-f713-4078-989f-d875f235ac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5837b992-d9fd-4811-a6e5-86bce70a20d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5837b992-d9fd-4811-a6e5-86bce70a20d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df478ef-3882-45dc-896a-1e928f9743a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602768aecb644bf2850d4419b4acd4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd62fcdd-685b-48a4-9734-3ce68ae01da6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:27Z,use_quota=True,user_id='2a205c35e36f4b268e5d03f392691d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068f50bb-d3df-473a-9e3a-39758ec99c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068f50bb-d3df-473a-9e3a-39758ec99c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1333539-c3fa-4d5e-bfdb-cc1527174893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1333539-c3fa-4d5e-bfdb-cc1527174893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3df478ef-3882-45dc-896a-1e928f9743a4', 'volume_name': 'volume-3df478ef-3882-45dc-896a-1e928f9743a4', 'volume_size': 1, 'snapshot_id': 'cd62fcdd-685b-48a4-9734-3ce68ae01da6'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a3d632-ef13-45d0-b216-49bdbb2f0d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a3d632-ef13-45d0-b216-49bdbb2f0d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aac6da-2c90-4aa5-8070-7777c511ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:26 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Volume 3df478ef-3882-45dc-896a-1e928f9743a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3df478ef-3882-45dc-896a-1e928f9743a4', 'volume_size': 1, 'snapshot_id': 'cd62fcdd-685b-48a4-9734-3ce68ae01da6'}
Apr 15 16:36:26 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e" returned: 0 in 0.655s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:26 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:26 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:26 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:26 devstack sudo[89956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 1G
Apr 15 16:36:26 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:27 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.420s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:27 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Deleted volume successfully.
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-1d4a9573-ae83-405a-9820-c4fe56413dfe tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-d9b89324-e994-407c-8a45-6ae7960da349-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:27 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 1G" returned: 0 in 0.501s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833178df-4585-4d7b-ad8f-222140d67b1e -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:27 devstack sudo[89963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833178df-4585-4d7b-ad8f-222140d67b1e -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9
Apr 15 16:36:27 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-5489174a-79e4-4075-ad32-a4a7ca20f18c-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:27 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-5489174a-79e4-4075-ad32-a4a7ca20f18c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833178df-4585-4d7b-ad8f-222140d67b1e -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9" returned: 0 in 0.448s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:27 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 is being set with open permissions: ugo+rw
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:27 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9
Apr 15 16:36:27 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "cinder-quobyte-5489174a-79e4-4075-ad32-a4a7ca20f18c" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-5489174a-79e4-4075-ad32-a4a7ca20f18c" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8881d4b-70cf-4e08-8ea8-e0adafbc96ab]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:27 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:27 devstack sudo[89971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c
Apr 15 16:36:27 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:28 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9" returned: 0 in 0.402s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:28 devstack sudo[89974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.info
Apr 15 16:36:28 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:28 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c" returned: 0 in 0.478s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:28 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c
Apr 15 16:36:28 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:28 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.info" returned: 0 in 0.426s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:28 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.info is being set with open permissions: ugo+rw
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:28 devstack sudo[89982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.info
Apr 15 16:36:28 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:28 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-5489174a-79e4-4075-ad32-a4a7ca20f18c" returned: 0 in 0.432s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-quobyte-5489174a-79e4-4075-ad32-a4a7ca20f18c" released by "delete_volume" :: held 0.933s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Created reservations ['285d0620-0eeb-48af-a4a3-70d96d6bcadd', '386d1830-5161-4914-9ec8-b5d17606865b', '7041a34f-f913-45a9-8925-c573ea7d9386', '10d896b6-f37d-4ba6-9533-209bbc2bf055'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:28 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:28 devstack sudo[89991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:28 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:29 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.info" returned: 0 in 0.441s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.951s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.438s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1725036807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e20f1e0-bb82-42f1-8ccb-6e375b896e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833572c4c3134c299f217963bf0cf6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:27Z,use_quota=True,user_id='24db6d4feb534fae93dce8d470a75d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Creating volume 9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:29 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:29 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ae670b43-43fd-4e96-b738-713d852ddfd6 tempest-CreateVolumesFromSnapshotTest-767878613 None] Create snapshot completed successfully
Apr 15 16:36:29 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 1073741824
Apr 15 16:36:29 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:29 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.468s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:29 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Deleted volume successfully.
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-54b2c079-2d23-487c-9ade-9099f47338a3 tempest-CreateVolumesFromSourceVolumeTest-310815593 None] Lock "cinder-5489174a-79e4-4075-ad32-a4a7ca20f18c-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:29 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 1073741824" returned: 0 in 0.637s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:29 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09
Apr 15 16:36:29 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (d211ed8e-8270-4c3f-aadb-2c9cd2b887ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:29 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e015aa-1c41-4cab-a52e-bcad21458272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e015aa-1c41-4cab-a52e-bcad21458272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808036206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53167cc7-0e57-4c8f-b31f-26a0fb57b9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:30Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a39247e-589e-4aaf-8071-8572f64abbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a39247e-589e-4aaf-8071-8572f64abbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a5d63d-e4c8-4d8e-a3f6-e61391c7e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a5d63d-e4c8-4d8e-a3f6-e61391c7e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53167cc7-0e57-4c8f-b31f-26a0fb57b9b9', 'volume_name': 'volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66039911-1513-43f7-af60-47573b92e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66039911-1513-43f7-af60-47573b92e247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89cfbb7-9899-4090-9596-fe28da1de53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume 53167cc7-0e57-4c8f-b31f-26a0fb57b9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9', 'volume_size': 1}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (d0746287-9772-497c-a96a-65d794da7b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187772ed-4de4-4965-8c49-10fdc6589a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187772ed-4de4-4965-8c49-10fdc6589a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-885376629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e778e6ae-112c-4dae-8978-04f0ec2b4fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:30Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2f976-346a-4d35-bd1f-da16ac004e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2f976-346a-4d35-bd1f-da16ac004e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09cca52-2b61-4162-8a02-2a4e0a3ada39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09cca52-2b61-4162-8a02-2a4e0a3ada39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e778e6ae-112c-4dae-8978-04f0ec2b4fb3', 'volume_name': 'volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2011de-c775-49e6-bf3c-070f19547011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2011de-c775-49e6-bf3c-070f19547011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ffc0b6-4d6a-4ee4-9f1f-18a5a73a1be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume e778e6ae-112c-4dae-8978-04f0ec2b4fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3', 'volume_size': 1}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:30 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" returned: 0 in 0.445s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.387s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "cinder-quobyte-cd62fcdd-685b-48a4-9734-3ce68ae01da6-3df478ef-3882-45dc-896a-1e928f9743a4" by "_create_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c7cb5d-05a2-4500-98e8-3952075ac620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bee3be-6bb1-43d6-b479-003c2e6ba3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-cd62fcdd-685b-48a4-9734-3ce68ae01da6-3df478ef-3882-45dc-896a-1e928f9743a4" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Creating volume 3df478ef-3882-45dc-896a-1e928f9743a4 from snapshot cd62fcdd-685b-48a4-9734-3ce68ae01da6 {{(pid=82156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "cinder-quobyte-3df478ef-3882-45dc-896a-1e928f9743a4" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Volume volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 (9e20f1e0-bb82-42f1-8ccb-6e375b896e09): created successfully
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bee3be-6bb1-43d6-b479-003c2e6ba3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Flow 'volume_create_manager' (8956b510-11e6-4e24-a249-768d32c57d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-3df478ef-3882-45dc-896a-1e928f9743a4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] snapshot: cd62fcdd-685b-48a4-9734-3ce68ae01da6, volume: 3df478ef-3882-45dc-896a-1e928f9743a4,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:36:30 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-941fe9bf-0ba7-4436-946a-42a92c51d9bc tempest-VolumeDependencyTests-829296961 None] Created volume successfully.
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae9161d-2401-42bb-9603-8a9035dfa154]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (e6ab581c-bacb-4cef-974a-f5290ed7d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6155a186-0eb8-46d2-ac84-fdcb28bf022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6155a186-0eb8-46d2-ac84-fdcb28bf022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190048458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be53b9e-67ce-47e5-ae76-706d53394798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:30Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56b0f6b-cbbf-4f5f-ba99-a73c496399f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56b0f6b-cbbf-4f5f-ba99-a73c496399f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fcb5a7-9de0-47d8-bd09-1e860c7b257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fcb5a7-9de0-47d8-bd09-1e860c7b257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be53b9e-67ce-47e5-ae76-706d53394798', 'volume_name': 'volume-7be53b9e-67ce-47e5-ae76-706d53394798', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7219818f-b287-4f60-8b0b-76fa3dd7b95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7219818f-b287-4f60-8b0b-76fa3dd7b95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6
Apr 15 16:36:30 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9323ad-8793-4700-a753-d05ab6ae6f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume 7be53b9e-67ce-47e5-ae76-706d53394798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be53b9e-67ce-47e5-ae76-706d53394798', 'volume_size': 1}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (b25f9df7-a27c-4a1f-bc0f-3a0ca77de795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3034d57-1b81-4dfc-b7c5-94920c663572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3034d57-1b81-4dfc-b7c5-94920c663572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-711220422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4028e1-12c4-403a-a567-369c4103a7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:31Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67671bfa-cdfe-45d4-a65f-a040e65a628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67671bfa-cdfe-45d4-a65f-a040e65a628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f741bd3f-93dc-44be-89ba-93d0609503d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f741bd3f-93dc-44be-89ba-93d0609503d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4028e1-12c4-403a-a567-369c4103a7fb', 'volume_name': 'volume-9e4028e1-12c4-403a-a567-369c4103a7fb', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3bdccd-d9ca-40c2-ad31-c05ebf9f635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3bdccd-d9ca-40c2-ad31-c05ebf9f635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b58d784-57c2-4d20-81b4-65bf9c4bbe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume 9e4028e1-12c4-403a-a567-369c4103a7fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4028e1-12c4-403a-a567-369c4103a7fb', 'volume_size': 1}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (0b828833-3ed0-4010-a7e3-94ba62d192bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b6c002-47b7-48fe-8a9b-d961438809ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b6c002-47b7-48fe-8a9b-d961438809ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1688029298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:31Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1136414-99ca-4e9e-b02f-00b2d21ee92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1136414-99ca-4e9e-b02f-00b2d21ee92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3204b9-e0a1-4737-aa79-a2ba7a61e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3204b9-e0a1-4737-aa79-a2ba7a61e2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4', 'volume_name': 'volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35df518c-bb6e-40be-86d0-1c1661ed62aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35df518c-bb6e-40be-86d0-1c1661ed62aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40123a40-ea3f-4de4-8d9b-110ca72ade50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4', 'volume_size': 1}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Flow 'volume_create_manager' (26b2cafb-050e-4074-a88e-6b84dec756b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85954dd8-3d0f-4f18-8c67-fef4e66cab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85954dd8-3d0f-4f18-8c67-fef4e66cab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990360b9-f25f-4540-b748-a2247bdaa35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb7b97035f649e9953ad7e2e7214bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:31Z,use_quota=True,user_id='51bfdaf0f76a4787851f85dda3818d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff89c27-18ab-4fa3-88af-e44c766b7a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff89c27-18ab-4fa3-88af-e44c766b7a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed15633a-d5f9-49d3-bda2-8b9ce0850fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed15633a-d5f9-49d3-bda2-8b9ce0850fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990360b9-f25f-4540-b748-a2247bdaa35d', 'volume_name': 'volume-990360b9-f25f-4540-b748-a2247bdaa35d', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d188fe-3221-426b-88e0-b0838c37f429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d188fe-3221-426b-88e0-b0838c37f429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1051a8f0-c9c8-4d31-b548-7de396bfd285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:30 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Volume 990360b9-f25f-4540-b748-a2247bdaa35d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990360b9-f25f-4540-b748-a2247bdaa35d', 'volume_size': 1}
Apr 15 16:36:30 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:31 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6" returned: 0 in 0.688s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086938a2-aecc-4690-a0fd-5919c14216bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa8b52-c949-411b-b241-0108a46bfcf2]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Flow 'volume_create_manager' (415edf94-21d7-41e3-b682-762bffd434d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebe7ce2-3b28-425b-86d8-a4121b863f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:31 devstack sudo[90008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd
Apr 15 16:36:31 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebe7ce2-3b28-425b-86d8-a4121b863f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1277559629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb46c0f-8ce5-4533-80ce-18555de40da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833572c4c3134c299f217963bf0cf6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=9e20f1e0-bb82-42f1-8ccb-6e375b896e09,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:31Z,use_quota=True,user_id='24db6d4feb534fae93dce8d470a75d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10105869-b375-41ad-a6e3-3f567f440550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10105869-b375-41ad-a6e3-3f567f440550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c546c8b9-6139-436a-8dec-406a8071bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c546c8b9-6139-436a-8dec-406a8071bde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fdb46c0f-8ce5-4533-80ce-18555de40da5', 'volume_name': 'volume-fdb46c0f-8ce5-4533-80ce-18555de40da5', 'volume_size': 1, 'source_volid': '9e20f1e0-bb82-42f1-8ccb-6e375b896e09', 'source_volstatus': 'available'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f0745b-9f32-4dbd-ba01-3cc77bb2360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f0745b-9f32-4dbd-ba01-3cc77bb2360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322fad39-e5bd-4d3c-9a7c-e9b5026a3e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:31 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Volume fdb46c0f-8ce5-4533-80ce-18555de40da5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fdb46c0f-8ce5-4533-80ce-18555de40da5', 'volume_size': 1, 'source_volid': '9e20f1e0-bb82-42f1-8ccb-6e375b896e09', 'source_volstatus': 'available'}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:31 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd" returned: 0 in 0.508s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:36:31 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:31 devstack sudo[90013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4
Apr 15 16:36:31 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:33 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4" returned: 0 in 2.051s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:33 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c415739d-d215-45d4-b213-43723518e255]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:33 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:33 devstack sudo[90025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd
Apr 15 16:36:33 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:34 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd" returned: 0 in 0.596s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:36:34 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Converted 1024.00 MB image at 499.04 MB/s
Apr 15 16:36:34 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4 is being set with open permissions: ugo+rw
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:34 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4
Apr 15 16:36:34 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:34 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4" returned: 0 in 0.398s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-3df478ef-3882-45dc-896a-1e928f9743a4" released by "_copy_volume_from_snapshot" :: held 4.321s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-cd62fcdd-685b-48a4-9734-3ce68ae01da6-3df478ef-3882-45dc-896a-1e928f9743a4" released by "_create_volume_from_snapshot" :: held 4.351s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.377s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.609s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808036206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53167cc7-0e57-4c8f-b31f-26a0fb57b9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:30Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Creating volume 53167cc7-0e57-4c8f-b31f-26a0fb57b9b9 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:34 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:34 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9 1073741824
Apr 15 16:36:34 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aac6da-2c90-4aa5-8070-7777c511ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df478ef-3882-45dc-896a-1e928f9743a4', 'volume_size': 1, 'snapshot_id': 'cd62fcdd-685b-48a4-9734-3ce68ae01da6'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4962a9c8-e84d-4b68-87a2-d830ae0aad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:34 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Volume volume-3df478ef-3882-45dc-896a-1e928f9743a4 (3df478ef-3882-45dc-896a-1e928f9743a4): created successfully
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4962a9c8-e84d-4b68-87a2-d830ae0aad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:34 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Flow 'volume_create_manager' (f9688c6c-f713-4078-989f-d875f235ac9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:34 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-e1bc0676-c7f7-4dee-9eea-78e17318dc41 tempest-SnapshotDependencyTests-1627030888 None] Created volume successfully.
Apr 15 16:36:35 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9 1073741824" returned: 0 in 0.531s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:35 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9
Apr 15 16:36:35 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "cinder-cd62fcdd-685b-48a4-9734-3ce68ae01da6-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-cd62fcdd-685b-48a4-9734-3ce68ae01da6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "cinder-quobyte-086938a2-aecc-4690-a0fd-5919c14216bd" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-086938a2-aecc-4690-a0fd-5919c14216bd" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "cinder-quobyte-cd62fcdd-685b-48a4-9734-3ce68ae01da6" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-cd62fcdd-685b-48a4-9734-3ce68ae01da6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Deleting offline snapshot cd62fcdd-685b-48a4-9734-3ce68ae01da6 of volume 086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] snapshot_file for this snap is: volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b512857-cfb3-45f6-9b7b-178bb93d1301]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:35 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6
Apr 15 16:36:35 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:35 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9" returned: 0 in 0.414s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.405s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-885376629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e778e6ae-112c-4dae-8978-04f0ec2b4fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:30Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Creating volume e778e6ae-112c-4dae-8978-04f0ec2b4fb3 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:35 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89cfbb7-9899-4090-9596-fe28da1de53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:35 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3 1073741824
Apr 15 16:36:35 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7be142b-0719-4871-a69c-ee95edea71b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:35 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9 (53167cc7-0e57-4c8f-b31f-26a0fb57b9b9): created successfully
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7be142b-0719-4871-a69c-ee95edea71b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (d211ed8e-8270-4c3f-aadb-2c9cd2b887ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:35 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8b443d40-d56e-4918-bd22-f0ffd7dbf70a tempest-CreateVolumesFromSnapshotTest-767878613 None] Created volume successfully.
Apr 15 16:36:35 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6" returned: 0 in 0.483s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086938a2-aecc-4690-a0fd-5919c14216bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafc8f4c-7d7f-4ed2-81db-33178d416c56]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:35 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:35 devstack sudo[90060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd
Apr 15 16:36:35 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:36 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3 1073741824" returned: 0 in 0.568s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:36 devstack sudo[90087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3
Apr 15 16:36:36 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:36 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd" returned: 0 in 0.547s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:36 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6
Apr 15 16:36:36 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:36 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3" returned: 0 in 0.448s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.206s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190048458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be53b9e-67ce-47e5-ae76-706d53394798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:30Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Creating volume 7be53b9e-67ce-47e5-ae76-706d53394798 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:36 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ffc0b6-4d6a-4ee4-9f1f-18a5a73a1be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:36 devstack sudo[90095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798 1073741824
Apr 15 16:36:36 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15977db7-378a-49e8-a7af-1b9ee9b56f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:36 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3 (e778e6ae-112c-4dae-8978-04f0ec2b4fb3): created successfully
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15977db7-378a-49e8-a7af-1b9ee9b56f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (d0746287-9772-497c-a96a-65d794da7b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:36 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-daa8d11b-4960-433a-bfb0-692a32a3fb85 tempest-CreateVolumesFromSnapshotTest-767878613 None] Created volume successfully.
Apr 15 16:36:36 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6" returned: 0 in 0.462s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:36 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:36 devstack sudo[90100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6
Apr 15 16:36:36 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:37 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798 1073741824" returned: 0 in 0.574s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:37 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd.cd62fcdd-685b-48a4-9734-3ce68ae01da6" returned: 0 in 0.452s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:37 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798
Apr 15 16:36:37 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-cd62fcdd-685b-48a4-9734-3ce68ae01da6" released by "_delete_snapshot" :: held 2.009s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-086938a2-aecc-4690-a0fd-5919c14216bd" released by "delete_snapshot" :: held 2.023s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Created reservations ['4c0fb92b-9f9e-4cde-bec9-47367bd00334', 'b7d38bc6-2c19-4414-a859-c9cafa2a931d', '7f147aad-c7ea-43f1-852c-8422ced871cf', '3a73b259-2ee3-4467-bcc9-df4bdaaa80fc'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Delete snapshot completed successfully.
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-6bd463cb-ac74-4c83-803a-19826f0dcc03 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-cd62fcdd-685b-48a4-9734-3ce68ae01da6-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:37 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798" returned: 0 in 0.432s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.055s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-711220422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4028e1-12c4-403a-a567-369c4103a7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:31Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Creating volume 9e4028e1-12c4-403a-a567-369c4103a7fb {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:37 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9323ad-8793-4700-a753-d05ab6ae6f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be53b9e-67ce-47e5-ae76-706d53394798', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e81cc70-cc9a-4294-b1d7-26d423900556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:37 devstack sudo[90110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb 1073741824
Apr 15 16:36:37 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:37 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume volume-7be53b9e-67ce-47e5-ae76-706d53394798 (7be53b9e-67ce-47e5-ae76-706d53394798): created successfully
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e81cc70-cc9a-4294-b1d7-26d423900556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:37 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (e6ab581c-bacb-4cef-974a-f5290ed7d133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:37 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-4db22cf8-f37f-45f1-88e1-477db1826144 tempest-CreateVolumesFromSnapshotTest-767878613 None] Created volume successfully.
Apr 15 16:36:38 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb 1073741824" returned: 0 in 0.550s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:38 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb
Apr 15 16:36:38 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "cinder-086938a2-aecc-4690-a0fd-5919c14216bd-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-086938a2-aecc-4690-a0fd-5919c14216bd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "cinder-quobyte-086938a2-aecc-4690-a0fd-5919c14216bd" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-086938a2-aecc-4690-a0fd-5919c14216bd" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8204d689-a5ff-4f4c-855a-a5c8a65ae9d7]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:38 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd
Apr 15 16:36:38 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:38 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb" returned: 0 in 0.403s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.803s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1688029298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9bd7fc32664ea4a849c6fcda4e4a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:31Z,use_quota=True,user_id='dd06ece13ea04a88bd1546a69fa074a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Creating volume ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:38 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b58d784-57c2-4d20-81b4-65bf9c4bbe1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4028e1-12c4-403a-a567-369c4103a7fb', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec37d443-4470-4539-b89d-3c201b3e942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:38 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4 1073741824
Apr 15 16:36:38 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:38 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume volume-9e4028e1-12c4-403a-a567-369c4103a7fb (9e4028e1-12c4-403a-a567-369c4103a7fb): created successfully
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec37d443-4470-4539-b89d-3c201b3e942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (b25f9df7-a27c-4a1f-bc0f-3a0ca77de795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:38 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c40753ab-3c81-4c24-a21d-ab45e9dae1d4 tempest-CreateVolumesFromSnapshotTest-767878613 None] Created volume successfully.
Apr 15 16:36:38 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd" returned: 0 in 0.473s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:38 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:39 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd
Apr 15 16:36:39 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:39 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4 1073741824" returned: 0 in 0.495s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:39 devstack sudo[90130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4
Apr 15 16:36:39 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:39 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-086938a2-aecc-4690-a0fd-5919c14216bd" returned: 0 in 0.464s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-086938a2-aecc-4690-a0fd-5919c14216bd" released by "delete_volume" :: held 0.978s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Created reservations ['5f454196-8958-469d-ac85-d43e9105c690', '852b5d99-d738-486c-8965-a53717047c06', '0f4dfcb8-5053-481e-8076-696b5821a86c', 'e3f0c253-d11f-450e-a7b7-e7197b823dcf'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:39 devstack sudo[90133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:39 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "cinder-3df478ef-3882-45dc-896a-1e928f9743a4-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-3df478ef-3882-45dc-896a-1e928f9743a4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "cinder-quobyte-3df478ef-3882-45dc-896a-1e928f9743a4" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-3df478ef-3882-45dc-896a-1e928f9743a4" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[862acb62-1070-4327-881e-e38d3c726778]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:39 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4" returned: 0 in 0.443s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.685s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990360b9-f25f-4540-b748-a2247bdaa35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb7b97035f649e9953ad7e2e7214bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:31Z,use_quota=True,user_id='51bfdaf0f76a4787851f85dda3818d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Creating volume 990360b9-f25f-4540-b748-a2247bdaa35d {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:39 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:39 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4
Apr 15 16:36:39 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40123a40-ea3f-4de4-8d9b-110ca72ade50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:39 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d 1073741824
Apr 15 16:36:39 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c0430f-1a84-487c-919e-b12234a5c652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:39 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Volume volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4 (ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4): created successfully
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c0430f-1a84-487c-919e-b12234a5c652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:39 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Flow 'volume_create_manager' (0b828833-3ed0-4010-a7e3-94ba62d192bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:39 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-f5653105-99a3-4233-a393-0fe498bf0744 tempest-CreateVolumesFromSnapshotTest-767878613 None] Created volume successfully.
Apr 15 16:36:40 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.493s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:40 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Deleted volume successfully.
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-d3adb9c7-8fcf-4532-9e35-093125e39bca tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-086938a2-aecc-4690-a0fd-5919c14216bd-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:40 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4" returned: 0 in 0.500s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:40 devstack sudo[90147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4
Apr 15 16:36:40 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:40 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d 1073741824" returned: 0 in 0.503s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:40 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d
Apr 15 16:36:40 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-quobyte-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4" acquired by "delete_volume" :: waited 0.010s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c9ee6f-fa75-4f9d-8968-972954c44c3e]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:40 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-3df478ef-3882-45dc-896a-1e928f9743a4" returned: 0 in 0.445s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-quobyte-3df478ef-3882-45dc-896a-1e928f9743a4" released by "delete_volume" :: held 0.969s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Created reservations ['f37b2ecf-9ea8-473e-9bb3-3deed55ff11b', 'cb099041-062e-40ce-a69b-d2ebad2e08bb', '7915077d-56a9-4c32-a8a4-088ab4291326', '0abea313-1500-495c-a1f2-17d52ccfa5a1'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:40 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4
Apr 15 16:36:40 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:40 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:40 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:40 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d" returned: 0 in 0.508s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.536s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:40 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Cloning volume 9e20f1e0-bb82-42f1-8ccb-6e375b896e09 to volume fdb46c0f-8ce5-4533-80ce-18555de40da5
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Creating offline snapshot c1a517f4-d35d-4400-bf10-fbdb7944d13f of volume 9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1051a8f0-c9c8-4d31-b548-7de396bfd285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990360b9-f25f-4540-b748-a2247bdaa35d', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c3bc52-a2dd-41d5-81c8-e32149a46edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fed3edb-7a2b-4733-8e28-820e3c045a0f]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:40 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Volume volume-990360b9-f25f-4540-b748-a2247bdaa35d (990360b9-f25f-4540-b748-a2247bdaa35d): created successfully
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c3bc52-a2dd-41d5-81c8-e32149a46edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:40 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Flow 'volume_create_manager' (26b2cafb-050e-4074-a88e-6b84dec756b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:40 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-75647f2e-44e2-46c1-a861-0b49c946f76d tempest-CinderUnicodeTest-674593775 None] Created volume successfully.
Apr 15 16:36:40 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09
Apr 15 16:36:40 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:41 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4" returned: 0 in 0.563s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:41 devstack sudo[90163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4
Apr 15 16:36:41 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:41 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.454s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:41 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Deleted volume successfully.
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-5e5e134e-003b-4bcc-9e5f-f05c46ac10d1 tempest-SnapshotDependencyTests-1627030888 None] Lock "cinder-3df478ef-3882-45dc-896a-1e928f9743a4-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:41 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" returned: 0 in 0.551s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:41 devstack sudo[90168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f 1G
Apr 15 16:36:41 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:41 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4" returned: 0 in 0.479s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4" released by "delete_volume" :: held 1.071s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Created reservations ['8f506418-b4a5-4ec1-9c6f-de142d986568', '4fc1119c-13f6-40b9-8b52-cd377727d282', '9989008c-556d-43b3-9db8-818414751b2c', '876c7d09-47e0-4971-b6c3-96964fe5ee20'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:41 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:41 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.flows.manager.create_volume [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Flow 'volume_create_manager' (c7cdec1f-455f-4b81-aaac-2fe91501d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8a22c2-774d-4f25-af47-20ecffa969c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8a22c2-774d-4f25-af47-20ecffa969c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1537570996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a140ee7-5252-468b-b143-b8883b8e3a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb7b97035f649e9953ad7e2e7214bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:42Z,use_quota=True,user_id='51bfdaf0f76a4787851f85dda3818d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316c91f4-fffa-45a2-a97e-a9a123f86c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316c91f4-fffa-45a2-a97e-a9a123f86c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16826de-ae59-4aca-80f9-a0c3100e0b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16826de-ae59-4aca-80f9-a0c3100e0b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a140ee7-5252-468b-b143-b8883b8e3a41', 'volume_name': 'volume-1a140ee7-5252-468b-b143-b8883b8e3a41', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967a1258-32bd-465c-bd78-42c091648ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967a1258-32bd-465c-bd78-42c091648ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5121a059-1a7a-4fcf-ab02-d8578e0fa15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:41 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Volume 1a140ee7-5252-468b-b143-b8883b8e3a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a140ee7-5252-468b-b143-b8883b8e3a41', 'volume_size': 1}
Apr 15 16:36:41 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:42 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f 1G" returned: 0 in 0.671s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:42 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f
Apr 15 16:36:42 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:42 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.540s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:42 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Deleted volume successfully.
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8cd82333-2af3-4e57-9cb0-996a89adc553 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-ea4e9fd0-4b5a-4ba8-8590-007eb4825bf4-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:42 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f" returned: 0 in 0.449s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:42 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f is being set with open permissions: ugo+rw
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:42 devstack sudo[90183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f
Apr 15 16:36:42 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-9e4028e1-12c4-403a-a567-369c4103a7fb-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-9e4028e1-12c4-403a-a567-369c4103a7fb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-quobyte-9e4028e1-12c4-403a-a567-369c4103a7fb" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-9e4028e1-12c4-403a-a567-369c4103a7fb" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a762b53-2bcb-4d57-8457-b7228413fa76]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:42 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb
Apr 15 16:36:42 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:42 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f" returned: 0 in 0.511s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:42 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:43 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.info
Apr 15 16:36:43 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:43 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb" returned: 0 in 0.509s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:43 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb
Apr 15 16:36:43 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:43 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.info" returned: 0 in 0.473s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:43 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.info is being set with open permissions: ugo+rw
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:43 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.info
Apr 15 16:36:43 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:43 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e4028e1-12c4-403a-a567-369c4103a7fb" returned: 0 in 0.488s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-9e4028e1-12c4-403a-a567-369c4103a7fb" released by "delete_volume" :: held 1.045s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Created reservations ['b1c23c7d-a92f-41bb-9b29-f9aafdd491ba', 'f8b2d78f-5e4f-4f1c-be7f-67d41ac8550b', '703ce0c8-25a7-44a7-8da8-d360f6eb3c9c', '9e44e09b-f74e-40c1-9aa1-bdc2ad2a2db1'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:43 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:43 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:43 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.info" returned: 0 in 0.491s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-fdb46c0f-8ce5-4533-80ce-18555de40da5" by "_copy_volume_from_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-fdb46c0f-8ce5-4533-80ce-18555de40da5" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] snapshot: c1a517f4-d35d-4400-bf10-fbdb7944d13f, volume: fdb46c0f-8ce5-4533-80ce-18555de40da5,  {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:43 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c0887e-e03c-4ec5-b173-56ce5c52f720]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:44 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f
Apr 15 16:36:44 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:44 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.483s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:44 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Deleted volume successfully.
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-a317a9db-0024-43b0-a4f4-f82dd8e3e5f3 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-9e4028e1-12c4-403a-a567-369c4103a7fb-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:44 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f" returned: 0 in 0.529s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Creating direct copy from snapshot {{(pid=82156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c19fe9-3596-4077-b21d-c4d82f9ba9c7]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:44 devstack sudo[90209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09
Apr 15 16:36:44 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-7be53b9e-67ce-47e5-ae76-706d53394798-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-7be53b9e-67ce-47e5-ae76-706d53394798-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-quobyte-7be53b9e-67ce-47e5-ae76-706d53394798" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-7be53b9e-67ce-47e5-ae76-706d53394798" acquired by "delete_volume" :: waited 0.006s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8f6475-c6f8-46b2-9499-b6e5673c65d0]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:44 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:45 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798
Apr 15 16:36:45 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:45 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" returned: 0 in 0.561s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:45 devstack cinder-volume[82156]: DEBUG cinder.utils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Path /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5 not found in is_blk_device check {{(pid=82156) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:36:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:45 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5
Apr 15 16:36:45 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:45 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798" returned: 0 in 0.497s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:45 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:45 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798
Apr 15 16:36:45 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:46 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:46 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-7be53b9e-67ce-47e5-ae76-706d53394798" returned: 0 in 1.435s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:46 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-7be53b9e-67ce-47e5-ae76-706d53394798" released by "delete_volume" :: held 1.961s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Created reservations ['7c1c854f-b24b-4469-8b50-b0f8f0a702e2', '5433f654-8928-442f-811c-1b93d19bfbaf', '8ea0ce88-93c9-4a0d-85b7-e65be3bba7bc', '1f371cd1-74ab-4a2a-a88d-3924c454d48a'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:47 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:47 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-e778e6ae-112c-4dae-8978-04f0ec2b4fb3-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-e778e6ae-112c-4dae-8978-04f0ec2b4fb3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-quobyte-e778e6ae-112c-4dae-8978-04f0ec2b4fb3" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:47 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5" returned: 0 in 2.326s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-e778e6ae-112c-4dae-8978-04f0ec2b4fb3" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a3fc9d-9aef-4d78-a331-b977ca7864ee]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9733dee-3500-4325-b48b-603d6ffd0e37]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:47 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09
Apr 15 16:36:47 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:47 devstack sudo[90240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3
Apr 15 16:36:47 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:47 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.512s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:47 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Deleted volume successfully.
Apr 15 16:36:47 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c609acc1-bf66-4a55-9f23-faf4457920a7 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-7be53b9e-67ce-47e5-ae76-706d53394798-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:47 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3" returned: 0 in 0.548s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:48 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3
Apr 15 16:36:48 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:48 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" returned: 0 in 0.769s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.image.image_utils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5 {{(pid=82156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:36:48 devstack cinder-volume[82156]: INFO cinder.image.image_utils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Converted 1024.00 MB image at 440.17 MB/s
Apr 15 16:36:48 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5 is being set with open permissions: ugo+rw
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:48 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5
Apr 15 16:36:48 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:48 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-e778e6ae-112c-4dae-8978-04f0ec2b4fb3" returned: 0 in 0.505s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-e778e6ae-112c-4dae-8978-04f0ec2b4fb3" released by "delete_volume" :: held 1.083s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Created reservations ['ac9f6191-86f3-4e2e-9cbb-9729e04e0255', '0aef23cc-9d22-4df7-9e85-3aa641ddb837', '403c427a-2053-4cbd-8ef7-2b353c374867', '8685bcfc-c991-4337-b9cf-a7202191d263'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:48 devstack sudo[90260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:48 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:48 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-fdb46c0f-8ce5-4533-80ce-18555de40da5" released by "_copy_volume_from_snapshot" :: held 4.725s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-c1a517f4-d35d-4400-bf10-fbdb7944d13f" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-c1a517f4-d35d-4400-bf10-fbdb7944d13f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Deleting offline snapshot c1a517f4-d35d-4400-bf10-fbdb7944d13f of volume 9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] snapshot_file for this snap is: volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e88e4e-7c3b-4fa5-ab6e-c2ce12145613]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:48 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:48 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f
Apr 15 16:36:48 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:49 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.465s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:49 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Deleted volume successfully.
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-bc93896a-cfce-4056-91b3-22cfdf16b16d tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-e778e6ae-112c-4dae-8978-04f0ec2b4fb3-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:49 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f" returned: 0 in 0.479s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8409f55d-5a48-4093-ad99-b759e155a933]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:49 devstack sudo[90268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09
Apr 15 16:36:49 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-quobyte-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9" acquired by "delete_volume" :: waited 0.007s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c62a2b7-a7b4-48f0-88df-7f28351dfcf4]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:49 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9
Apr 15 16:36:49 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:49 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" returned: 0 in 0.497s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:49 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f
Apr 15 16:36:49 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_service.periodic_task [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82156) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:49 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:49 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:49 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:50 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9" returned: 0 in 0.460s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:50 devstack sudo[90282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9
Apr 15 16:36:50 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:50 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f" returned: 0 in 0.457s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:50 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f
Apr 15 16:36:50 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:50 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.436s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ec52576b-0c2f-49d3-832f-449ca945973c None None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:50 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9" returned: 0 in 0.446s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9" released by "delete_volume" :: held 0.928s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Created reservations ['28af8b6e-c2fa-4fe5-8909-40188a7aed96', '92588f93-f4bf-499e-b454-a51111a283b6', '1d7f0fbf-c75b-4539-915e-1f94c154ab72', 'ab6036f0-3e09-4d10-b274-edacb5ba284e'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:50 devstack sudo[90292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:50 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:50 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09.c1a517f4-d35d-4400-bf10-fbdb7944d13f" returned: 0 in 0.428s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-c1a517f4-d35d-4400-bf10-fbdb7944d13f" released by "_delete_snapshot" :: held 1.913s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-67fd1ba4-49d6-40a9-9b8c-8804f233aca9-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.936s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.766s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe8ea2f31f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:36:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1537570996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a140ee7-5252-468b-b143-b8883b8e3a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb7b97035f649e9953ad7e2e7214bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:36:42Z,use_quota=True,user_id='51bfdaf0f76a4787851f85dda3818d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0314b1-5d2b-4c13-af92-1bed44327eb8),volume_type_id=ca0314b1-5d2b-4c13-af92-1bed44327eb8)}" {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Creating volume 1a140ee7-5252-468b-b143-b8883b8e3a41 {{(pid=82156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Selected osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6 as target Quobyte volume. {{(pid=82156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:36:50 devstack cinder-volume[82156]: INFO cinder.volume.drivers.remotefs [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] casted to osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41 1073741824 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:50 devstack sudo[90294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41 1073741824
Apr 15 16:36:50 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322fad39-e5bd-4d3c-9a7c-e9b5026a3e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb46c0f-8ce5-4533-80ce-18555de40da5', 'volume_size': 1, 'source_volid': '9e20f1e0-bb82-42f1-8ccb-6e375b896e09', 'source_volstatus': 'available'}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e03dde6-747f-4fa2-9cd2-525605101864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-67fd1ba4-49d6-40a9-9b8c-8804f233aca9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-quobyte-833178df-4585-4d7b-ad8f-222140d67b1e" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:50 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Volume volume-fdb46c0f-8ce5-4533-80ce-18555de40da5 (fdb46c0f-8ce5-4533-80ce-18555de40da5): created successfully
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e03dde6-747f-4fa2-9cd2-525605101864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Flow 'volume_create_manager' (415edf94-21d7-41e3-b682-762bffd434d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-833178df-4585-4d7b-ad8f-222140d67b1e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-quobyte-67fd1ba4-49d6-40a9-9b8c-8804f233aca9" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:50 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-fa81eb97-d5cc-49ad-8d8b-8e13c336bc42 tempest-VolumeDependencyTests-829296961 None] Created volume successfully.
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-67fd1ba4-49d6-40a9-9b8c-8804f233aca9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Deleting offline snapshot 67fd1ba4-49d6-40a9-9b8c-8804f233aca9 of volume 833178df-4585-4d7b-ad8f-222140d67b1e {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] snapshot_file for this snap is: volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79f922e-ea7a-4fab-a159-99e130330136]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:50 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9
Apr 15 16:36:50 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:50 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.427s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:50 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Deleted volume successfully.
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-9e603f04-8306-4925-9693-01c5712c9d0c tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-53167cc7-0e57-4c8f-b31f-26a0fb57b9b9-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:51 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41 1073741824" returned: 0 in 0.505s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:51 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41
Apr 15 16:36:51 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:51 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9" returned: 0 in 0.515s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833178df-4585-4d7b-ad8f-222140d67b1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[254ca288-22b9-4baa-bbf1-2cb201c761c0]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:51 devstack sudo[90307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e
Apr 15 16:36:51 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-9e20f1e0-bb82-42f1-8ccb-6e375b896e09-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Lock "cinder-9e20f1e0-bb82-42f1-8ccb-6e375b896e09-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6323f4-df43-4e64-a10c-d0889f7b4bfa]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:51 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09
Apr 15 16:36:51 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:51 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41" returned: 0 in 0.433s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'} {{(pid=82156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5121a059-1a7a-4fcf-ab02-d8578e0fa15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a140ee7-5252-468b-b143-b8883b8e3a41', 'volume_size': 1}' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ec9711-a47f-49af-977d-03df1e6df359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:36:51 devstack cinder-volume[82156]: INFO cinder.volume.flows.manager.create_volume [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Volume volume-1a140ee7-5252-468b-b143-b8883b8e3a41 (1a140ee7-5252-468b-b143-b8883b8e3a41): created successfully
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ec9711-a47f-49af-977d-03df1e6df359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82156) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Flow 'volume_create_manager' (c7cdec1f-455f-4b81-aaac-2fe91501d39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82156) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:36:51 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-da78a074-1a33-47a9-9df1-488eb546c706 tempest-CinderUnicodeTest-674593775 None] Created volume successfully.
Apr 15 16:36:51 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e" returned: 0 in 0.534s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:51 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:51 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9
Apr 15 16:36:51 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:52 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" returned: 0 in 0.475s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:52 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09
Apr 15 16:36:52 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:52 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9" returned: 0 in 0.448s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:52 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9
Apr 15 16:36:52 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:52 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" returned: 0 in 0.420s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-9e20f1e0-bb82-42f1-8ccb-6e375b896e09" released by "delete_volume" :: held 0.926s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Created reservations ['1f86fe0f-8c37-4218-8cc6-b0eba29f1c1d', 'a6f19d15-76f5-4f2c-9be3-0baebd6f38a5', '0caa9656-5af8-4c68-9b99-7c1fd265dc97', '77868ee1-0188-4ac2-82bc-ef85f098c385'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:52 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:52 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-fdb46c0f-8ce5-4533-80ce-18555de40da5-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-fdb46c0f-8ce5-4533-80ce-18555de40da5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-fdb46c0f-8ce5-4533-80ce-18555de40da5" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-fdb46c0f-8ce5-4533-80ce-18555de40da5" acquired by "delete_volume" :: waited 0.026s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd88959-b27b-4546-b51d-d68cfbb340e5]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Creating offline snapshot 40bedc69-f8e0-4c3f-8149-14b58dca3cd6 of volume 1a140ee7-5252-468b-b143-b8883b8e3a41 {{(pid=82156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 16:36:52 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5
Apr 15 16:36:52 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c0a123-5527-4951-ae4f-f464b84fd9ac]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:52 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e.67fd1ba4-49d6-40a9-9b8c-8804f233aca9" returned: 0 in 0.531s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-67fd1ba4-49d6-40a9-9b8c-8804f233aca9" released by "_delete_snapshot" :: held 2.090s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-833178df-4585-4d7b-ad8f-222140d67b1e" released by "delete_snapshot" :: held 2.107s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:52 devstack sudo[90333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41
Apr 15 16:36:52 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Created reservations ['f64965d7-26e8-4ee5-ad68-582db5e55741', 'eb958494-56af-4d94-9ec5-ce6d74a520b5', 'b6e07d24-4671-4954-979e-cc6045143941', '7c3c7019-2700-4582-b029-c31060cad553'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:52 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Delete snapshot completed successfully.
Apr 15 16:36:52 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-82353517-2f44-4757-9bc4-89f60aa11a80 tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-67fd1ba4-49d6-40a9-9b8c-8804f233aca9-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:53 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.511s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:53 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Deleted volume successfully.
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-8d1248db-a65c-4d36-aab5-a663e596beda tempest-VolumeDependencyTests-829296961 None] Lock "cinder-9e20f1e0-bb82-42f1-8ccb-6e375b896e09-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:53 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5" returned: 0 in 0.548s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:53 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:53 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5
Apr 15 16:36:53 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41" returned: 0 in 0.482s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 1G {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:53 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 1G
Apr 15 16:36:53 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:53 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-fdb46c0f-8ce5-4533-80ce-18555de40da5" returned: 0 in 0.414s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-fdb46c0f-8ce5-4533-80ce-18555de40da5" released by "delete_volume" :: held 0.993s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Created reservations ['fb8a3f8d-0a40-463b-a708-b11e1d6c8cc9', 'd1bed08c-43df-4474-a5e8-6c1669ab5d1f', 'c2bea650-a046-462e-a434-6d2d02e76e54', 'a7eac372-ef37-4a32-a370-54240f9c5ff5'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:53 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-833178df-4585-4d7b-ad8f-222140d67b1e-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:53 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:53 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 1G" returned: 0 in 0.526s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a140ee7-5252-468b-b143-b8883b8e3a41 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-833178df-4585-4d7b-ad8f-222140d67b1e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:53 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a140ee7-5252-468b-b143-b8883b8e3a41 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6
Apr 15 16:36:53 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "cinder-quobyte-833178df-4585-4d7b-ad8f-222140d67b1e" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-833178df-4585-4d7b-ad8f-222140d67b1e" acquired by "delete_volume" :: waited 0.011s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd842576-425c-4a85-8c3c-1958fb330569]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:53 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:53 devstack sudo[90354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e
Apr 15 16:36:53 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:54 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.448s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:54 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Deleted volume successfully.
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-c69837c9-c645-4594-85dc-e16cdac5a0b4 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-fdb46c0f-8ce5-4533-80ce-18555de40da5-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:54 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a140ee7-5252-468b-b143-b8883b8e3a41 -F qcow2 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6" returned: 0 in 0.439s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:54 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 is being set with open permissions: ugo+rw
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:54 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6
Apr 15 16:36:54 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:54 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e" returned: 0 in 0.491s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:54 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e
Apr 15 16:36:54 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:54 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6" returned: 0 in 0.403s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:54 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.info
Apr 15 16:36:54 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:54 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-833178df-4585-4d7b-ad8f-222140d67b1e" returned: 0 in 0.429s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-1bbd503e-f19f-4a1a-8795-4e787ba9af31-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-quobyte-833178df-4585-4d7b-ad8f-222140d67b1e" released by "delete_volume" :: held 0.960s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-1bbd503e-f19f-4a1a-8795-4e787ba9af31-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "cinder-quobyte-1bbd503e-f19f-4a1a-8795-4e787ba9af31" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Created reservations ['fff05d2f-8676-4543-b2b5-771c41fc67aa', '56b94a24-e800-4e52-9d0e-cd061be43cc4', '7eae8405-c07d-4796-874d-41427321e79a', '7f06c937-2cd0-4c60-b58e-ff2e50b8a883'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-1bbd503e-f19f-4a1a-8795-4e787ba9af31" acquired by "delete_volume" :: waited 0.009s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c663c1-22f8-4838-97c2-b8ebe0187282]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:54 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:55 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31
Apr 15 16:36:55 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:55 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:55 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:55 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.info" returned: 0 in 0.439s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:55 devstack cinder-volume[82156]: WARNING cinder.volume.drivers.remotefs [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.info is being set with open permissions: ugo+rw
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.info {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:55 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.info
Apr 15 16:36:55 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:55 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.410s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:55 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Deleted volume successfully.
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-988407f0-b8bb-475b-af5a-bbb8bdcc780f tempest-CreateVolumesFromSnapshotTest-767878613 None] Lock "cinder-833178df-4585-4d7b-ad8f-222140d67b1e-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:55 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31" returned: 0 in 0.479s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:55 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31
Apr 15 16:36:55 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:55 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.info" returned: 0 in 0.413s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:55 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-7d27656d-b69d-472d-aa4a-fdcb974c0e9d tempest-CinderUnicodeTest-674593775 None] Create snapshot completed successfully
Apr 15 16:36:55 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1bbd503e-f19f-4a1a-8795-4e787ba9af31" returned: 0 in 0.411s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-quobyte-1bbd503e-f19f-4a1a-8795-4e787ba9af31" released by "delete_volume" :: held 0.916s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Created reservations ['01b25be5-621d-4f48-845d-cda2ae5df955', 'f1972765-c12f-4ca3-9b17-61445871e65f', 'ae5fb418-ad81-4779-acce-785b9c75c2b4', '3e94c47a-3b8f-4f40-b1ee-2e3dfb83c204'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Acquiring lock "cinder-40bedc69-f8e0-4c3f-8149-14b58dca3cd6-delete_snapshot" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Lock "cinder-40bedc69-f8e0-4c3f-8149-14b58dca3cd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Acquiring lock "cinder-quobyte-1a140ee7-5252-468b-b143-b8883b8e3a41" by "delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:55 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:36:55 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Lock "cinder-quobyte-1a140ee7-5252-468b-b143-b8883b8e3a41" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:55 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Acquiring lock "cinder-quobyte-40bedc69-f8e0-4c3f-8149-14b58dca3cd6" by "_delete_snapshot" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Lock "cinder-quobyte-40bedc69-f8e0-4c3f-8149-14b58dca3cd6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Deleting offline snapshot 40bedc69-f8e0-4c3f-8149-14b58dca3cd6 of volume 1a140ee7-5252-468b-b143-b8883b8e3a41 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] snapshot_file for this snap is: volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 {{(pid=82156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b793837-abd2-487f-a3c2-63275caed694]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:56 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6
Apr 15 16:36:56 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:56 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.440s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:36:56 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Deleted volume successfully.
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-cbf2552a-c1f2-4973-abdb-262d72bb3f37 tempest-VolumeDependencyTests-829296961 None] Lock "cinder-1bbd503e-f19f-4a1a-8795-4e787ba9af31-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:56 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6" returned: 0 in 0.548s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.remotefs [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a140ee7-5252-468b-b143-b8883b8e3a41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[17590219-c1f8-4fdd-b035-8fff4a33a49c]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:56 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:56 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41
Apr 15 16:36:56 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:57 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41" returned: 0 in 0.611s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:57 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6
Apr 15 16:36:57 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:57 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6" returned: 0 in 0.441s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:57 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:57 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6
Apr 15 16:36:57 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:58 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:58 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41.40bedc69-f8e0-4c3f-8149-14b58dca3cd6" returned: 0 in 0.427s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Lock "cinder-quobyte-40bedc69-f8e0-4c3f-8149-14b58dca3cd6" released by "_delete_snapshot" :: held 2.100s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Lock "cinder-quobyte-1a140ee7-5252-468b-b143-b8883b8e3a41" released by "delete_snapshot" :: held 2.127s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:58 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Created reservations ['2907d110-38f0-43b4-8a49-6973fa958d08', '045ab2d6-7b5f-478c-b24b-2736c81123eb', 'b54f54c2-6f31-4f9d-afcb-c01ec51278cf', '4ac6ead5-34a8-4343-8663-7f45eb2561ce'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:36:58 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Delete snapshot completed successfully.
Apr 15 16:36:58 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-20fbb0cb-c6c3-46dc-a321-f6de336b4688 tempest-CinderUnicodeTest-674593775 None] Lock "cinder-40bedc69-f8e0-4c3f-8149-14b58dca3cd6-delete_snapshot" released by "delete_snapshot" :: held 2.224s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:36:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Acquiring lock "cinder-1a140ee7-5252-468b-b143-b8883b8e3a41-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Lock "cinder-1a140ee7-5252-468b-b143-b8883b8e3a41-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Acquiring lock "cinder-quobyte-1a140ee7-5252-468b-b143-b8883b8e3a41" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:36:59 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Lock "cinder-quobyte-1a140ee7-5252-468b-b143-b8883b8e3a41" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:36:59 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd51ddd-4bea-4db8-8b03-8bfa51000071]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:36:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:59 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41
Apr 15 16:36:59 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:36:59 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 15 16:36:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41" returned: 0 in 0.477s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:36:59 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:36:59 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41
Apr 15 16:36:59 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:37:00 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-1a140ee7-5252-468b-b143-b8883b8e3a41" returned: 0 in 0.403s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Lock "cinder-quobyte-1a140ee7-5252-468b-b143-b8883b8e3a41" released by "delete_volume" :: held 0.913s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Created reservations ['a7628a78-8ab2-439d-9e62-b5ad20483408', '965569a8-9bc5-4ab0-b256-ba4d25ee95ec', '7b40018d-9b48-4848-a096-70dcba2fc42e', 'c124d54a-5631-42be-b975-19b8f855e5b9'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:37:00 devstack sudo[90417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:37:00 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Acquiring lock "cinder-990360b9-f25f-4540-b748-a2247bdaa35d-delete_volume" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Lock "cinder-990360b9-f25f-4540-b748-a2247bdaa35d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Acquiring lock "cinder-quobyte-990360b9-f25f-4540-b748-a2247bdaa35d" by "delete_volume" {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Lock "cinder-quobyte-990360b9-f25f-4540-b748-a2247bdaa35d" acquired by "delete_volume" :: waited 0.008s {{(pid=82156) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f7a8ec-a4e4-4b9a-a40d-df0ddb201b19]: (4, 'qcow2') {{(pid=83065) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:37:00 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d
Apr 15 16:37:00 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:37:00 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.454s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:37:00 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Deleted volume successfully.
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-ae7f9226-c634-466f-bb8d-3f1aa0865c2d tempest-CinderUnicodeTest-674593775 None] Lock "cinder-1a140ee7-5252-468b-b143-b8883b8e3a41-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:37:00 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d" returned: 0 in 0.480s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:37:00 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:37:00 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d
Apr 15 16:37:00 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:37:01 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361/volume-990360b9-f25f-4540-b748-a2247bdaa35d" returned: 0 in 0.403s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Lock "cinder-quobyte-990360b9-f25f-4540-b748-a2247bdaa35d" released by "delete_volume" :: held 0.906s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG cinder.quota [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Created reservations ['a8de814f-8e78-4aea-91ef-cd5fe609c852', '432fcfd8-4996-4198-8208-976bb1123c79', '2ff7db79-6067-45c3-81b7-a6c9e917b1da', '6fb869f8-bbb8-4f75-9e80-325f390e207a'] {{(pid=82156) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6': None} {{(pid=82156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG cinder.volume.drivers.quobyte [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c570a23e-77f5-418f-a6f5-feadbc45f4d6'] {{(pid=82156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.lockutils [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82156) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361 {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:37:01 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361
Apr 15 16:37:01 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:37:01 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG oslo_concurrency.processutils [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab9906cb66fc6891d8d0aada1b78a361" returned: 0 in 0.456s {{(pid=82156) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG cinder.manager [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Notifying Schedulers of capabilities ... {{(pid=82156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:37:01 devstack cinder-volume[82156]: INFO cinder.volume.manager [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Deleted volume successfully.
Apr 15 16:37:01 devstack cinder-volume[82156]: DEBUG cinder.coordination [None req-2410bbeb-6ce4-4116-a57e-e49575be685c tempest-CinderUnicodeTest-674593775 None] Lock "cinder-990360b9-f25f-4540-b748-a2247bdaa35d-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82156) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:37:11 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=190,cinder:INSERT=78,cinder:UPDATE=259,cinder:DELETE=24 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:37:11 devstack cinder-volume[82156]: DEBUG dbcounter [-] [82156] Writing DB stats cinder:SELECT=199,cinder:INSERT=60,cinder:UPDATE=297,cinder:DELETE=23 {{(pid=82156) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}